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them out. It enters Into a true dialog with a person, 
responding to English sentences with actions and English 
replies, and asking for clarification when Its heuristic 
programs cannot disambiguate a sentence through use of context 
or physical knowledge. 
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procram Is not a detailed psychological theory 




In fact be very Informative 
may be a reasonable 


simulation. 

Language understanding Is a kind of In 
In which a pattern of sounds or written mar 
Into a structure of concepts In the mind of 

Understand the meaning; 3. Think about the 
parse a sentence Is controlled by a conttnu 
Interpretation which guides us In a "meanln 


ctual activity. 

Interpreted 
Interpreter. Wt 










When we see Che sentence "He gave Che boy planes Co water." 
we don't get tangled up In an Interpretation which would be 

"boy plants" doesn't make sense like "house plants" or "boy 
scouts", so we reject any parsing which would use It. 

Syntax, semantics, and Inference must be Integrated In a 
close way, so that they can share In the responsibility for 
Interpretation. Our program must Incorporate the flexibility 

constantly talking to the others. We have explored several 
techniques for Integrating the large bodies of complex knowledge 
needed to understand language. Two are particularly Important. 

First, we use a type of syntactic analysis which Is 
designed to deal with questions of semantics. Rather than 
concentrating on the exact form of rules for shuffling around 
linguistic symbols. It studies the way language Is structured 
around choices for conveying meaning. The parsing of a sentence 
Indicates Its detailed structure, but more Important It 
abstracts the “features" of the linguistic components which are 
Important for Interpreting their meaning. The syntactic theory 
Includes an analysis of the way language Is structured to convey 
n through systematic choices of features. The other 


features, rather than having to deal with minor details of the 



distinction 







1.1.? Organization of the Language Understanding Process 



It useful to write special programs f 

Interplay between them which makes th 
parser does not parse a sentence, the 
Interpreter. As It finds each piece . 

structure. It checks Its semantic IntepretatIon, 
It Is plausible, then (If posslbh 


syntactic 


-i*s knowledge of the world, b 

his has been done In a limited way by other systems, 
program It Is an integral part of understanding at 
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meaning, we need a semantic system which provides prim 

and syntactic constructions. The system Includes mech 
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understand a wide range of responses, and It Is possible to 
express elmost anything In a syntactically simple way. However 
It takes a sophisticated semantic and deductive capability to 
phrase things In a way which Is meaningful and natural In 
discourse, since the form of a response depends on both the 
context and on what the speaker assumes that the hearer knows 
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The special Idlom-defInlng capabilities allow 
us to Include such pleasantries without 
modifying the grammar. 


HillpMii 









their meaning. 

We want to analyze the possible choices of features and 
functions which grammatical structures can have. For example, 
we might note that all sentences must be either IMPERATIVE, 
DECLARATIVE, or a QUESTION, and that In the last case they must 
choose os well between being a TES-NO Question or a WH- Question 
containing a word such as "why" or "which". We con study the 
way In which these features of sentences are organized — which 
ones form mutually exclusive sets (called "systems"), and which 




containing YES-NO and WH- depends on the presence of QUESTION). 
This can be done not only for full sentences, but for smaller 






In addition we can study the different functions a 
syntactic "unit" can have as a part of a larger unit. In 
"Nobody wants to be alone.", the clause "to be alone" has the 
function of 08JECT In the sentence, while the noun group 
"nobody" Is the SUBJECT. We can note that a transitive clause 
must have units to fill the functions of SUBJECT and OBJECT, or 


that a WH- Question has to have some constituent which has the 
role of "question element" (like "why" In "Why did he go?" or 











structure of the sentence. There Is no rearrangeme 
supposed "underlying" forms. Instead, each constlt 
marked with features Indicating Its structure and f 
Instead of saying that "Did John go?" has an underl 
structure which looks like "John went.", we simply 
has the features QUESTION and VES-NO, and that the 
"John" has the function SUBJECT. Other parts of tl 
understanding process do nc 
way the parsing tree Is structured, since 








random unrelated 
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w form of specific syntactic r 
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2.1.2 Parsing 

In Implementing a systemic grammar 

e patterns and features In It. 

Ilzatlon rules — Interpretation rules which loo 
n, Identify Its structure, and recognize Its rel 
This Interpretation process Is closely rela 
es of pattern recognition, and many Interest! 
can be drawn with Che process of Interprettn 
e CWInograd 1969>>. The Important aspect 
erpretatlon Is looking for symbolic features 

f Isolating Important features from complex I 
presenting them symbolically Is a central Issue 
I Intelligence, and the Idea of a "systemic" 


problem 




r for PROGRAMMAR, . 
s basically a top-i 



















today show this sane tendency! See Minsky's remark In his 
Turin* lecture tMlnsky 1970>. Our parser uses semantic *uldance 
at all points, lookln* for a meaningful parsing of the sentence 
rather than trying all of the syntactic possibilities. Section 
2.2 describes PROGRAMMAR In detail, and 2.3 gives a sample 
grammar for English. Section 2.4 explains programming details, 
and shows how the special features of the language are actually 
used to handle specific linguistic problems. 























applled 


unordered set of rules. Each rule can be 


times at any point In the derivation where the symbol appears. 


e applIcatlons o 


the giraffe.", or have used l.J and 1.8 to get "The giraffe 
dreams." This type of derivation can be represented graphically 



description Independent of the work presented In later sections. 










































with the CLAUSE "sawing logs" as a constituent (a modifier of 
"student"). 

The constituents "who", "three days", "some of the men on 
the board of directors," and "anyone who doesn't understand me" 
are all noun groups, exhibiting different features. This means 
that a PROGRAMMAR grammar will have only a few programs, one to 
deal with each of the basic units. Our current grammar of 
English has programs for the units CLAUSE, NOUN GROUP, VERB 
GROUP, PREPOSITION GROUP, and ADJECTIVE GROUP. 
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2.2.6 Context - Sens)tlye Aspects 
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We have used the PROGRAMMAR functions FQ and TRNSF, which 
attach features to constituents. The effect of evaluating (FQ 
A) Is to add the feature A to the list of features for the 
currently active node of the parsing tree. TRNSF Is used to 
transfer features from the pointer to the currently active node. 

example, line 5.8 looks for the features SINGULAR and PLURAL In 





determiner 












1 . 1 . 7 Amblgul tv and understanding 

Readers familiar with parsing systems may by now have 
wondered about the problem of ambiguity. As explained, a 
PROGRAMMAR program tries to find a possible parsing for a 
sentence, and as soon as It succeeds. It returns Its answer. 

This Is not a defect of the system, but an active part of the 
concept of language for which It was designed. The language 
process Is not segmented Into tho operation of a parser, 
followed by the operation of a semantic Interpreter. Rather, 
the process Is unified, with the results of semantic 
Interpretation being used to guide the parsing. This Is very 
difficult In other forms of grammar, with their restricted types 
of context-dependence. But It Is straightforward to Implement 
In PROORAMMAR. For example, the last statement In a program for 
NP may be a call to a noun-phrase semantic Interpreter. If It 
Is Impossible to Interpret the phrase as It Is found, the 
parsing Is Immediately redirected. 

The way of treating ambiguity Is not through listing all 
121*5 possible Interpretations of a sentence, but In being 


Intelligent In looking for the first one, an 
intelligent In looking for the next one If t 
no automatic backup mechanism In PROGRAMMAR, 




good PROGRAMMAR 
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without considering the alternatives simultaneously, we want to 
handle semantic ambiguity very differently. There may be 
several Interpretations of a sentence which are all more or less 
meaningful, and the choice between them will depend on a complex 
evaluation of our knowledge of the world, of the knowledge the 
person speaking has of the world, and of what has been said 




In understand In* the reason for developing PROGRAMMAR, 
several factors are Important. The first Is that only through 
the flexibility of expressing a grammar as a program can we 
Introduce the type of Intelligence necessary for complete 
language understanding. PROGRAMMAR Is able to take Into account 
the fact that language Is structured In order to convey meaning, 
and that our parsing of sentences depends Intimately on our 
understanding that meaning. PROGRAMMAR can take advantage of 
this to deal more efficiently with natural language than a 
general rule-based system, whether context-free or 
transformational. More Important, the analysis returned by 
PROGRAMMAR Is designed to serve as a part of a total 
understanding process, and to lend Itself directly to semantic 
Interpretation. This was one reason for selecting systemic 
grammar, and has guided much of the design of the system. The 
exact way In which semantic Interpretation can be done, and the 
reasons why a systemic analysis Is Important will be discussed 


sections 











2.5.1 About the Grammar 

This section describes the grammar of English used by our 
system. It Is based on the principles of systemic grammar 
(<Ha)11 day 1961, 1966a, 1966b, 1967>>, and emphasizes the 
analysis of the significant features exhibited by llngustlc 
structures, rather than their detailed form. Instead of giving 
a set of graemer rules or algorithms, this section will try to 
convey an Impressionistic overview of English grammar, giving 
examples of the most Important features. Section 2.5.11 follows 
the parser through two sample sentences, showing how the grammar 
Is used. The actual PROGRAMMAR grammar contains the details, 
and Is available on reouest. A few particularly Interesting 
parts of the detailed grammor are described In section 2.6. 
Appendix A Is a glossary of features with references to the 


pages on which they are Illustrated. 

Before beginning, several warnings are In order, 
this Is not by any means a complete grammar of English, 
task of codifying an entire language In any formalism I 


research project. Our goal was to cover a large enough portion 
of English syntax so that a user could converse comfortably with 
the system about Its toy-block world. There are whole areas of 
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differences a 

theoretical d 
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was to produce a working gramm 
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overrode more theoretical 
rammar Is not very "pretty". 


coordinate the 
ins of systemic 


more complete 
simply notatlonal {using dl 
lers are Intentional stmpllflca 
i more complete), and ■ 
ferences (for example, our analysis of 
i of the structure Into tl 













rather than syntactic rules, while Halllday's Is more purely 
syntactic.). Me will not describe the differences In detail, 
since this Is not a proposal for a specific version of English 

language, and at English, pointing out some of the Interesting 







2.3.2 Units . Rank , and Features 

We will begin by describing some O' 
systemic grammar, before giving details 
analysis. Some of the description Is i 

explanation of systemic grammar to expl. 
give a more thorough explanation of Its 

The first Is the notion of syntactic units 

of smaller parts). If we look at * 
t syntactic structures are usua 
e, with many levels of branching 

ch are used for conveying differ 
example, the sentence "The 


Systemic graimnar pays mor. 

Is organized Into units, each i 
conveying meaning. In English 
ranks of units, the CLAUSE, the GROUP, am 
several types of groups: NOUN GROUP (NG), 
PREPOSITION GROUP (PREPG) and ADJECTIVE Gl 
systemic grammar, the same sentence might 


etltlon of material 
give enough 
ROGRAMMAR. Here we 


ranches at any 

of the meaning. 

















lls analysis, the WORD Is the basic building block, 
word classes like "adjective" , “noun", "verb", and 

:a! bits (like analyglng "doss" as being composed of 

xhlbiting features . The word "dogs" Is the same basic 
Item as "dog", but has the feature "plural" Instead 
r". The words "took", "take", "taken", "taking”, 

II the same basic word, but with differing features 
it participle" (EN), "Infinitive" (INF), "-Ing" 

When discussing features, we will use several 
ionventlons. Any word appearing In all upper-case 
the actual symbol used to represent a feature In our 
semantic programs. A feature name enclosed In 
' English version which Is more Informative. Usually 
version Is an abbreviation of the English version, 
is we will Indicate this by typing the letters of the 

’ Is abbreviated as DET, we may write DETermtner. We 
te things like QuaNTIFIeR. When we want to be more 
will write "quantifier" (f|NTFR). 

:t larger unit than the WORD Is the GROUP, of which 


describe objects, verb 


conveying meaning, 
groups (VG> carry 


* messages about 







the time and modal (logical) status of an event or relationship, 
preposition groups (PI1EPG) describe simple relationships, while 
adjective groups (ADJO) convey other kinds of relationships and 
descriptions of objects. These semantic functions are described 
In more detail In section k.l. 

composed. For example, a NG has slots for "determiner" (GET), 
"numbers" (NUK), "adjectives" (ADJ), "classifiers" (CUSF), and 
a NOUN. Each group can also exhibit features, just os a word 
can. A NG can be "singular" (NS) or "plural" (NPl), "definite" 
(DEF) as In "the three dogs" or "Indefinite" (INDEF) as In "a 
steak", and so forth. A VG can be "negative" (NEG) or not, can 


Finally, the top rank Is the i 
rather than sentences since the sei 
discourse and semantics than a sep. 
Is either a single clause or a ser 
In a simple structure such as "A a 
conjoining structures separately s 


e syntactic s 
of clauses joined together 


a separate syntactic unit f 


The clause Is the most complex and diverse unit of the 
language, and Is used to express complex relationships and 
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related by a definite logical structure. The choice between 
YES-NO and WH- Is meaningless unless the clause Is a QUESTION, 
but If It Is a QUESTION, the choice must be made. Similarly, 
the choice between QUESTION, IMPERATIVE, and DECLARATIVE Is 
mandatory for a MAJOR clause (one which could stand alone as a 
sentence), but Is not possible for a "secondary" (SEC) clause, 
such as "the country which possesses ihfi bomb• 1 The choice 
between PASV (as In "the ball was attended by John",) and ACTV 
(as In "John attended the ball.") Is on a totally different 
dimension, since It can be made regardless of which of these 

We can represent these logical relationships graphically 
using a few simple conventions. A set of mutually exclusive 
features (such as QUESTION, DECLARATIVE, and IMPERATIVE) Is 
called a system , and Is represented by connecting the features 

(QUESTION 
DECLARATIVE 
IMPERATIVE 

The vertical order Is not Important, sine 
set of unordered features among which w 

for the choice to be meaningful. This 
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conditions. 








features C and D depends on the presence of either * at B, we 





















2-i.i Iha CLAUSE 


The scructure exhibiting the greatest variety In English Is 
the CLAUSE. It can express relationships and events Involving 
time, place, manner, and other modifiers. Its structure 
Indicates what parts of the sentence the speaker wants to 
emphasize, and can express various kinds of focus of attention 
and emotion. It determines the purpose of an utterance -- 
whether It Is a question, command, or statement — and Is the 


themselves when their purpose I 

The CLAUSE has several main ingredients and a number o 
optional ones. Except for special types of incomplete clau* 

Indicates the basic event or relationship being expressed b 
CLAUSE. Almost every CLAUSE contains a subject, except for 
IMPERATIVE (In which the semantic subject I 
the person being addressed), and embedded clauses I 
subject lies somewhere else In the syntactic s 
addition to the subject, a CLAUSE may have various k! 
objects, which will be explained In detail later. If 
many types of modifiers (CLAUSES, GROUPS, and WORDS) 
Indicate time, place, manner, causality, and a varlef 
aspects of meaning. One part of the CLAUSE system ni 
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CLAUSE Is marked with the feature REIDEL. 
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ITSUBJ. TO and ING clauses can do the same: 


11 wl11 be fun see them again. 
ts62> It was dangerous EOlng ng without g parachute. 

The final type of RSNG Is the WHRS, which Is almost 


Identical to the WHRS RSO described above. Rather than go 
through the details again, we will Indicate how a few of our RSQ 
examples (sentences s32 to sSO) can be converted, and will leave 


(s6S) I don t know what In iLJ H with. PREPREL DANGLING 
(56k) Ask him align Jig mi born. RELAOJ 
S65) He told me why. RELAOJ SHORTREL 

(566) It Is amazing how many Puerto Ricans there are In 

t , EGA ton. SUBJTREL 

(567) On Iy her hairdresser knows what color her hair was. 




Into which the relative element can fit. In this case. It Is 
the RSNG TO clause "Jane to buy", which Is missing Its object. 
This clause then has the feature UPREL, which Indicates that Its 
missing constituent Is somewhere above In the structure. More 
specifically It Is 0BJ1UPREL. 

Once this connection Is found, the program might change the 
pointers In the structure to place the relative as the actual 
0BJ1 of the embedded clause structure. In the current grammar. 






the pointers ere left untouched, end speclel commends to the 
moving function • ere used when the object Is referenced by t 
semantic progrem. 


Section 




2.3.It Transitivity In the Clause 

In addition to the systems we have already described, there 
Is a TRANSITIVITY system for the CLAUSE, which describes the 
number and nature of Its basic constituents. We mentioned 
earlier that a CLAUSE had such components as a subject and 
various objects. The transitivity system specifies these 
exactly. We have adopted a very surface-oriented notion of 
transitivity. In which we note the number and basic nature of 
the objects, but do not deal with their semantic roles, such as 
"range” or "beneficiary". Halllday's analysis <Halllday 1S67> 

Is somewhat different, as It Includes aspects which we prefer to 


Our simplified 
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very different possibilities for conveying meaning, and 
do not have the full range of syntactic choices open to 
clauses. BE clauses are divided Into two types -- THE 



only a subject, marked 










CLAUSE has a SUBJect and a COUPI ament. The COMPlement can be 


n agent of the FBI. 


(s72) The kins was in the counting house. 

(s73) Her strength was fantastic. 

(s7k) My daddy Is stronger than yours. 

Other clauses are divided according to the number and type 
of objects they have. A CLAUSE with no objects Is Intransitive 
<ITRNS)t 

Cs75) He Is running. 

With one object It Is transitive (TRAMS)1 
(s76) He runs g milling machine. 

With two objects TRANS21 


e of a special type whlc 

lock an iti table, 
s cannot be considered a 


(s79) He runs a milling machine In Chicago. 

cannot say “Put the block." This type of CLAUSE Is called 
TRANSL, and the location object Is the LOBJ. The LOBJ can be a 
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2.3.5 Noun Groups 

look at the "slot and filler" analysis, which describes the 
different components It can have. Some types of NG, such as 


111 be explained separately later, 
typclal NG structure, uslni a to 


of these "slots" are optional, and may or may not be filled In 
any particular NG. The meanings of the different symbols are 


G Structure 


The most Important Ingredient Is the NOUN, which 
always present (If It Isn't, the NG Is INCOMplete). I 
the basic Information about the object or objects beln 
to by the NG. Immediately preceding the NOUN, there a 
arbitrary number of "classifiers" (CLASF). Examples o 


water meter cover adjustment s 


Hal 11 day 
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object, a class of objects, a group of objects, etc. The 
determiner COST) Is the normal start for a NG, and can be a 
such as "a", or "that", or a possessive. It Is followed bv 

ordinals ("first, second, third...") and a few others such 


Cs95) the neat three d. 


e complex construction 


e combinations o 




















containing only the head and qualifiers, and In which an 
adjective can follow the head, as ini 

(s95> anything ereen which Is bigger than the moon 

The feature PROPNG marks an NG made up of proper nouns, 
such as "John", "Oklahoma”, or "The Union Of Soviet Socialist 


Repub)Ics." 

These three special classes of NG do not have the structure 
described above. The PRONG Is a single PRONoun, the PROPNG Is a 
string of PROPNs, and the TPRONG has Its own special syntax. 


The rest of the NGs are the unmarked (normal) type. They could 
be classified according to exactly which constituents are 



meaning of the NG and the way It relates to other units. We 
distinguish betwen those with a determiner (marked DET) and 


those without one (NOET), as Ini 


<s97) Cats adore fish. NDET 

(s98) The cat adored g fish. DET 


(like “a" or "an"), or a quantifier (QNTFR) (like "some". 


DEMonstratlve ("this", "that”, etc.) or the word "the" (the 
unmarked case), or a POSSessIve NG. The NG "the farmer's son" 





P>ee 


determiner, and has the feature 







Possess Ives 
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7 . 3 . 6 Preposition Groups 

The PREPG Is a comparatively simple structure used to 
express a relationship. It consists of a PREPosItlon followed 
by an object (PREPOBJ), which Is either a NG or a RSNG CLAUSE. 

combination Instead of a single word, as Ini 

Csll!) next is the table 
(5113) ah too of the house 

The grammar Includes provision for this, and the dictionary 
lists the possible combinations and their meanings. The words 
In such a combination ore marked as PREP2. The network for the 



In the kitchen ? 











a locational object (LOBJ): 

(5115) Put It fin the table. 
an ADJUNCTt 

(sll6) He *ot It Jut selIIne his aoul. 

(Sll7> It was bought Jt* the dev 11. 

If the PREPO Is a constituent of a QUESTION CLAUSE, It Cl 
the question element by having a QUEST NR as Its object: 
(sllg) In what city 
Csll9> for how many days 




(sl21) the place in which she works 

If the CLAUSE Is an UPQUEST or an UPREL, the PREPG can be 
the constituent which Is "missing" the piece which provides the 
upward reference. In this case It Is also marked UPREL: 

or UPQUEST: 

<sl2i) Mho did you knit It far? 

In these cases. It Is also marked SHORT to Indicate that the 
object Is not explicitly In the PREPG. It can also be short 
It Is a PREPG In a DANGLING PREPQ or PREPREL CLAUSE: 

(sUA) what do you keep It in? 


qualifier (Q>: 




in the Iron mask 
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2.3.8 Verb Groups 

combination of tense 


group Is designed to convey a complex 
so that an event can relate several time 


iu will have been 1 


This t 


f recursive ten 
y Ha 111 day <Halllday J966b> and o 

d MODAL. Once a choice between tl 


of the auxllllary verb 


", "have", , 
nltlve forms of 


nal two positions, t 
Ice consecutively. 


>n!y In final position. 






































Section 




This system of tenses Is operative only for FINITE verb 
groups. The network for the VG In general Isi 



(s136) Fire when ready. 

(sl37> Don 't drop the baby. 

It consists of a verb In the INFInitlve form, possibly preceded 
by the auxllllary "do" or Its negative form "don't". The EN VG 

and consists of a past partlcple verb. The ING VG Is made up of 
an ING verb or the verb "being" followed by an EN verb. It Is 
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2.3.9 Words 


he features assigned to 
necessary to make arbitrary decisions 

classes or different features within 
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d their features, 
the constituents o 


"strange". The 
sst") and COMPARatlve (as 


modify other 








FEATURES 


iO NUMDALONE NUMRAN NUMDAT 


B INDOB2 I NT 




BBS WfS.KM 




Indicating 























or “more chan a million", there Is a NUMD. The features they 


have are (NUMOAN NUMDAS NUMOAT NUMDALONE). NUHDAN words 


are preceded 


NUMOALONE Indicates that the NUMD con stand alone with the 
number, and Includes "exactly" and "approximately". 

ORD — The class of ORDInals Includes the ordinal numbers 


"next", "last", and "only". Notice that superlative 
Objectives can also fill this slot In the NG. 




PREPosItion, either 




























used for these as they are critical In determining the 

person and number, distinguishing "third-person singular" 
(VJPS) as In "Is", "plural", as In "have", or "first 


Non-auxllllary verbs can be VPRT. which combine with a 
PBT, and they have a whole cluster of transitivity features. 
In Section 2.5.k we described the different transitivity 
features of the CLAUSE, and these are controlled by the verb. 
We therefore have the features (TRANS ITRNS TRANS2 TRANSL 
ITRNSL INT) In addition, the verb can control what types of 
RSNG CLAUSE can serve as Its various objects. The feature 





For example, the verb "want" has the features TOOB and 


"I want you to go." are grammatical, but "I want going. , 




3 ("breaking"), EN ("broken"), INFInltlve 
"broke"), and PRESent ("breaks”). The 


network does not Illustrate all of the relations, as some 
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2.3.10 Conjunction 

One of the most complex parts of English Is the system of 
conjunction. This section presents e simplified version which 
has been Implemented using the special Interrupt feature of 
PROGRAMMAR (see Section 2.4.2 for details). This makes the 
parsing particularly simple. 

replaced by a COMPOUND unit of the same type. In the sentence: 


hashish brownies. 


chocolate cake , three pies . , 


(S153) a ££d ag vellow flag 
or a phrase can be ambiguous, as Ini 
<SlS4) black cats and horsns 
This can be Interpreted as having either a COMPOUND NG, 
composed of the NGs "black cats" and "horses", or a single NG 


The features of a COMPOUND unit 

and by the type of conjunction. The conjunction 
e from the following network: 
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COMPOUND- 
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111ST 
-It 1ST* 
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FIGURE 


NETWORK 9 


The first choice Is the actual conjunction used. The 
feature BOTH Indicates a word at the be(lnnln( of a COMPOUND 


the specific word depends on the conjunction - 
"and", "either" with "or, and "neither" with " 
features BOTH and NOR 

A conjoined structure can be made up of two e 
conjunction (as In the previous three examples), o 
a conjunction before the 


conjunctions 










tsis7) cabbages and kin, 
Every constituent but 
COMPONENT. The COMPOUND ui 


d sealing wax and things 
first Is (narked with the feature 


constituents. It may have features such 
relevant to Its syntactic function. For - 
with the feature AND must be plural (NPL) 
feature OR will have the number feature o 


"dropped the 


as a conjunction < 

s• Similarly, th< 


(Sl59) He gave Greg the apple and Gloria t 
The clause "Gloria the pear" Is marked as VBFORK and SUBJFORK. 
The only constituents relative to a fork are those necessary fo 

(slGO) They easily saw the trouble ai 

both constituents, but leaves this dec 


cheerfully fixed I 
"easily" applies t 
Ion to semantics. 





p structure" 


province of the sementlc enalyzer. 






2-3.11 following the Parser In Operation 




rough two examples to 
We will not actually 
way semantic programs 

e different features 


which Is difficult enough 





explained above, means looking for a MAJOR CLAUSE. It activates 
the grammar by calling (PARSE CLAUSE MAJOR). Since CLAUSE Is 
one of our units, there Is a program defined for It. The CLAUSE 
program Is called with an Initial feature list of (CLAUSE 


The CLAUSE program looks at the first word. In order to 
decide what unit the CLAUSE begins with. If It sees an adverb. 
It assumes the sentence begins with a single-word modifier. If 
It sees a PREPosItlon, It looks for an Initial PREPG. If It 
sees a BINDER, It calls the CLAUSE program to look for a BOUND 


possibly all languages) the first word 


often gives 








phrase Indicated 
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Immediately below It and Indented. We use the symbol to 
Indicate the program which Is currently active, and show the 


outlIne, putting ui 




right of a unit 


Indicates that the program for that unit has not yet finished. 

Figure 39 shows that we have a CLAUSE, with a constituent 
which Is a VC, and that the VC program Is active. The VC so far 


consists of only a VB. Notice that some new properties have 
appeared on the list for VB. We have not mentioned TRANS or 
VPRT. These came from the definition of the word "pick" when we 
called the function PARSE for a word (see section 2.s.k for 


Ordinarily the VC program checks for various kinds of tense 


Immediately after finding the verb, 
the next example. 


When the VG program succeeds, CLAUSE takes over again. 
Since It has found the right kind of VC for an IHPERatlve 
CLAUSE, It puts the feature IMPER on the CLAUSE feature list. 

It then checks to see whether the MVB has the feature VPRT, 
Indicating It Is a special kind of verb which takes a particle. 
It discovers that "pick” Is such a verb, and next checks to see 








defined. 





















All of those things fall In our example, so It decl 
CLAUSE must have a NG as Its question element, (celled N 
marks this feature, and calls (PARSE NG QUEST). The NG 
starts out by noticing QUEST on Its Initial feature list 
looking for a question determiner (OET QDET). Since the 
only three of these ("which", "what", and "how many"), 
program checks for them explicitly, parsing "how" as a Q 

parsing tree, without worrying about Its features. (The 
(PARSE NIL X) checks to see If the next word Is actually 
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2.3.12 Analysts of Word Endings 

This section describes the "spelling rules" used by the 
program In recognizing Inflectional endings of words. For 
spoken language, these would be called the "morphophonemle" 
rules, but since we deal with written language, they are 
"morpho-graphemlc." 

These rules enable a reader to recognize that, for example, 
"pleasing" Is a form of "please", while "beating" Is a form of 
"beat". There Is a structure of conventions for doubling 
consonants, dropping "e", changing "I" to "y", etc. when adding 

dictionary, since It is a regular Inflected form of "run". The 
program can use an Interpretive procedure to discover the 
underlying form and attach the appropriate syntactic features 
for the Inflection. 

In designing a formalism for these rules. It seems most 
natural to express them as a program for Interpretation. The 
flow chert In Figure AS Is designed to handle a number of 
Inflectional endings -- "-n*t" for negative, "-'s" and for 
possessive, "-s" and Its various forms for plural nouns and 
singular third-person verbs, "-Ing", "-ed", and "-en" verb 
forms, the superlative "-est" and comparative "-er", and the 
adverbial "-!y". 

As the flowchart shows, these endings share many aspects of 
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4 Programming Details 


2.li.l Operation of the System 

Since the grammar Is Itself a program, there Is not much 
overhead mechanism needed for the basic operation of the parser. 
Instead, the system consists mostly of special functions to be 
used by the grammar. The system maintains a number of global 
variables, and keeps track of the parsing tree as It Is built by 
the main function, PARSE. When the function PARSE Is called for 
a UNIT which has been defined as a PROGRAMMAR program, the 


system collects 



falls. It restores the tree to Its state before the program was 
called, then returns control. A PROGRAMMAR program Is actually 
converted by a simple compiler to a LISP program and run In that 
form. The variables and functions available for writing 
PROGRAMMAR programs are described In the rest of part 2.4. In 






details more Independent 

We use the hypothetical 


1 our detailed 
ilmplIf led grammar 
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2.h.3 Possess I yes 












2.h.4 The Dictionary 

Since PROGRAMMAR Is embedded In LISP, the facilities of 
LISP for handling atom names are used directly. To define a 
word, a list of grammatical features Is put on Its property list 
under the Indicator WORD, and a semantic definition under the 
Indicator SMNTC. Two facilities are Included to avoid having to 
repeat Information for different forms of the same word. First, 
there Is an alternate way of defining words, by using the 
property Indicator W0RD1. This Indicates that the word given Is 

properties of Its root. A W0RD1 definition has three elements. 

features to be removed. For example, we might define the word 
"go" by: (DEFPROP GO (VERB INTRANSITIVE INFINITIVE) WORD) We 
could then define "went" as (DEFPROP WENT (GO 
(PAST)(INFINITIVE)) W0RD1) This Indicates that the feature 
INFINITIVE Is to be replaced by the feature PAST, but the rest 
(including the semantic definition) Is to remain the same as for 

The other facility Is an automatic system which checks for 
simple modifications, such as plurals, "-Ing," forms, "-er" and 
"-est" forms and so forth. If the word as typed In Is not 
defined, the program looks at the way It Is spelled, tries to 
remove Its ending (taking Into account rules such as 
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3-h.q Variables Maintained by the System 

There are two types of variables, those bound at the top 
level, and those which are rehound every time a PROGRAMMAR 




Variables 



Always points t' 


List of messages passed up from li 
levels. See Section 2.S.7 





















pointed 






2.5 Comparison with Other Parsers 


2.5.1 Older Parsers 

When work first began on analyzing natural language with 
computers, no theories of syntax existed which were explicit 
enough to be used. The early machine-translator designers were 
forced to develop their own linguistics as they worked, and they 
produced rough and ready versions. The parsers were collections 
of "packaging routines", "Inserted structure passes", "labeling 
subroutines", etc. (see <GarvIn>) which evolved gradually as 


harder and harder t 
Making extensions w 


t difficult ti 


the machine-translation effort failed. It seemed i 
ad been premature to try handling all of English 
better background of linguistic theory and an 
idlng of the mathematical properties of grammars, 
programs for natural language took two separate pa 
: was to Ignore traditional syntax entirely, and to 
: of more general pattern matching process to get 

Systems such as STUDENT, SIR 













theoretically a "i 
fact hlRhly biased 
rather than Interpretini 
In Interpretation Is r 
but extremely dlfflcul 


scrlptlon of lanRuaee, I 
-ocess of generating s< 











In the past two years, three related parsing systems have 
been developed to deal with the full complexity of natural 
language. The first was by Thorne, Bratley, and Dewar UThorne 


Fraser (<Bobrow 1969>) and Hoods CtMoods 1969>>. The three 
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rks can "capture t 

ar which differ on 
ne Is remembering 
t to explleitly st 


p regularities of the 
B two essentially Identical 
y In that the finite control 
ome piece of Information...1 
re the distinguishing piece 


argument! 

Similarly we can go through 
the ease of mixing semantics wltl 
operations which are "r 

looking at "transition 

What about "perspicuity 
transition networks retain 
understanding by humans) ol 
transformational grammars I 
given rule Is Intimately be 


with syntax, the ability to Include 

pply Identically whether we are 
ks" or "programs". 

? Woods claims that augmented 
e perspicuity (ease of reading and 
Impler grammar forms. He says that 
problem that "the effect of a 
with Its Interrelation to 


y require an extremely complex 


>f natural language. 


■ any grammar complex enough 
















erprctlng conjoined structures. This hes many uses, both In 
e grammar (such as "and") and In 
dllng Idioms and unusual structures. If we think In network 
Is Is like having a separate arc marked "and" leading 
y node In the network. Such a feature could probably 

natural to think In terms of programs ai 


A third difference Is the backup mechanism. The network 


approach 




following all of them. Either we have to carry forward 
simultaneous Interpretations, or keep track of our choices In 
such a way that the network can automatically revise Its choice 
If the original choice does not lead to an accepting state. 

This could be done In the program approach by using a language 
such as PLANNER with Its automatic backup mechanisms. But In 


section 2.2.7 we discussed the Question of whether It Is even 
desirable to do so In handling natural language. 

We pointed out the advantage of an Intelligent parser which 
can understand the reasons for Its failure at a certain point, 
and can guide itself accordingly Instead of backing up blindly. 
This Is Important for efficiency, and Woods Is very concerned 
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descriptive word and an arbitrary number, then prefixing the 
result with a colon to remind us It Is an object. The house 
mentioned above might be called :HOUSE37k. Properties and 
relations must also go under an assumed name, since (FLAT X) 
might mean very different things depending on whether X Is a 
tire or a musical note. We can do the seme thing (using a 
different punctuation mark, f) to represent these two meanings 
as fFLATl and »FLAT2. When the meaning Intended Is clear, we 
will omit the numbers, but leave the punctuation marks to remlnc 
us that It Is a property or relation rather than a specific 
object. Thus, our facts listed above should be written: 

(•CITY :BOISE) (fFATHEP-OF :N0AH :JAFETH), and either 

(#0L0 :OEGAULLE) or (PAGE iDEGAULLE »0L0). 

We are letting properties serve In a dual function — we 
can use them to say things about objects (as In "The sky Is 
blue." — ('BLUE :SKT)) or we can say things about them as If 
they were objects (as In "Blue Is a color." — (•COLOR PBLUE)). 

relationships to enter Into other relationships. (We 
distinguish between "rolotlon", the abstract symbol such as 
•FATHER-OF, and "relationship", a particular Instance such as 
(•FATHER-OF :HOAH :JAFETH)). In accord with our earlier 
convention about naming things, we can give the relationship a 












like (*FATHER-OF iNDAH sJAFETH). We cen keep straight which 
name goes with which relationship by putting the name directly 
Into the relationship. Our example would then become (fFATHER- 
OF iNOAH :JAFETH :REL76). There Is no special reason to put 
the name last, except that It mokes Indexing and reading the 
statements easier. We can tell that :REL76 Is the name of this 
relation, and not a partlclpont since FATHEP.-OF relates only two 
objects. Similarly, we knew that It has to be a participant In 
the relationship (KNOW :l :RFL76) since (KNOW needs two 



relationship 


properties (such 







Before going on, let us stop and ask what we are de 
the preceding paragraphs, we have developed a notation f 
representing certain kinds of meaning. In doing so we I 
glibly passed over Issues which have troubled phllsophe 
linguists for thousands of years. Countless treatises 
debates have tried to analyze Just what It means to be 
"object" or a "property", and what logical status a syi 
as SBLUE or fCITY should have. We will not attempt to 
philosophical answer to these questions, but Instead t 


Language Is a process of corr-un i cat Ion between people, 
is Inextricably enmeshed In the knowledge that those people 
about the world. That knowledge Is not a neat collection of 
definitions and axioms, complete, concise and consistent. 
Rather It Is a collection of concepts designed to manipulate 
Ideas. It Is In fact Incomplete, highly redundant, and often 
Inconsistent. There Is no self-contained set of "primitives" 
from which everything else can be defined. Definitions are 
circular, with the meaning of each concept depending on the 



o neither Immediate Introspection 










sulted for this job. 


just combinations of < 
r relation Is atomic m 


Ic concepts). 


logical status, but because It serves a useful purpose In 
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define e concept" and "those which describe I 
define fPERSON or 'JUSTICE, end he will cone 
or slogan which Is very limited. (JUSTICE Is 

cases. The model Is circular, with the meanl 
depending on the entire knowledge of the spea 
kind which would be Included In a dictionary) 
close similarity between the models held by t 
listener, or there could be no communication. 





difficulty understanding each other's political viewpoints. 
Fortunately, on simpler things such as (BLUE, 'DOG, and 'AFTER, 


practically Identical. In fact, for simple t 

"definition" , which corresponds to the tradl 
Returning to our notation, we see that I 

In English we can treat events and relationsh 
In "The war destroyed Johnson's rapport with 
our representation of meaning we can slmllarl 
such as 'WAR or a relationship of 'RAPPORT In 


I dictionary. 
Intentionally 




een "specific objects 1. 




ships". 








3.1-t Cnmnlp« Information 


particular objects, properties, and relat 
want to handle more complex Information, 
are yellow.", or "A thesis Is acceptable 
It contains a persuasive argument." Th 
a formal language such as the predicate c 


e of assertions about 
onshlps. Next, we 




relations such as Implies, or, and, there-exlsts, etc. are 
represented symbolically, and Information Is translated Into a 
"formula". Thus we might have: 


(FORALL (X) (IMPLIES(#CANARY X)(#COLOR X fYELLOW))> 
(FORALL (X)(IMPLIES 


(fACCEPTABLE X 


Calculus Representation 


Several notatlonal conventions a 


variables s 
particular 


say things about objects without naming 
I done with the quantifiers FORALL and 
logical relations like AND, OR, NOT, 


(fACCEPTABLE 














this problem end has developed a theorem-proving language called 
PLANNER <Hewltt 1961, 1969>. In PLANNER, theorems are In the 
form of programs, which describe how to go about proving a goal, 
or how to deduce consequences from an assertion. This Is 


described at length In section 5.5, and forms the basis for the 
Inference part of our English understander. In PLANNER, our 
sentence about thesis evaluation could be represented os shown 

This Is similar In structure to the predicate calculus 

The theorem Is a program, where each logical operator indicates 
a definite series of steps to be carried out. THGOAL says to 
try to find an assertion In the data base, or to prove It using 
other theorems. THUSE gives advice on what other theorems to 







theorem CONTENTS- 
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discussed In section 
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(THFIND ALL S?X (X V) 

<THGOAL!«NATION t?X>) 

(THANDCTHQOAL(ANAR *TV») 

(THGOAL(*PARTICIRATED «?X $?Y))>>) 
and PLANNER would return a !l«t of all such countrlas. Using 
our conventions for giving names to relations and events, we 


(THGOALt*CHICKEN S 
(THGOALffROAD «?Z> 
(THGOALtfCROSS S?Y 
(THGOALCfCAUSE JJX 
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5.2 Compart son with Previous Programs 
In Section 5.1 we discussed ways of represents 
Information and meaning within a language-comprehending system. 
In order to compare our Ideas with those In previous systems, we 
will establish a broad classification of the field. Of course, 
no set of pigeon-holes can completely characterize the 
differences between programs, but they can give us some 
viewpoints from which to analyze different people's work, and 

only with the ways that programs represent their Information 
about the subject matter they discuss. Issues such as parsing 
and semantic analysis techniques are discussed In other 
sections. He will distinguish four basic types of systems 
called "special format", "text based”, "restricted logic", and 
"general deductive". 











5-2-1 Special Format Systems 

Most Of the early language undestandlng programs were of 
the special format type. Such systems usually use two special 
formats designed for their particular subject matter — one for 
representing the knowledge thoy keep stored away, and the other 
for the meaning of the English Input. Some examples are: 
BASEBALL <P.F.Green), which stored tables of baseball results 
and Interpreted Questions as "specification lists" requesting 
data from those tables; SAO SAM <Llndsay>, which Interpreted 
sentences as simple relationship facts about people, and stored 
these In a network structure; STUDENT tBobrow 196k), which 
Interpreted sentences as linear equations and could store other 








minimum of concern for the complexities of lenguege. 
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3.2.3 Text Based Systems 

Some researchers were not satisfied with the limitations 
Inherent In the special-format approach. They wanted systems 
which were not limited by their construction to a particular 
specialized field. Instead they used English teat, with all of 
Its generality and diversity, as a basis for storing 
Information. In these “teat based" systems, a body of teat Is 
stored directly, under some sort of Indealng scheme. An English 
sentence Input to the understander Is Interpreted as a request 
to retrieve a relevant sentence or group of sentences from the 
teat. Various Ingenious methods were used to find possibly 
relevant sentences and decide which were most likely to sastlsfy 


PROTQSYIJTHEX I (Simmons 1966> had an Indea specifying all 


with tha request (using a special weighting formula), then did 
some syntactic analysis to sea whether the words In common were 
In tha right grammatical relationship to each other. Semantic 
Memory (Qullllan 1966> stored a slightly processed version of 
English dictionary definitions In which multiple-meaning words 
were eliminated by having humans Indicate the correct 
Interpretation. It then used an associative Indeklng scheme 
which enabled the system to follow a chain of Indea references. 
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sentences 


formal 1sm 


Limited Logic Systems 

systems, and has been used for most of the 
nguage understanding programs. First, some sort 
notation Is substituted for the actual English 
te base of stored knoledge. This notation may 
«rent forms, such as "desrlptlon lists" <Haphael 
|” tsimmons 196»> "coneept-reletlon-concept 
3 ns 1969>, "data nodes" <Qullllan 19S9> , "rings" 
relational operators" <Tharp> , etc. Each of these 
gned for efficient use In a particular system, but 
are all doing the same thing — providing a 
simple assertions of the sort described In section 
relatively unimportant which special form Is 
if the different methods can provide a uniform 


y of expressing It In English. Once this Is done, 
lave a way of translating from the English Input 
this Internal assertion format, and the greatest 
'ort In language understanding systems has been 
analysis". He will discuss It at length In 


e Interested li 




(Qullllan 


<Tharp>) 



systems, only partially breaking 






















5-3.li General Deductive Systems 

f limited logic systems were recognized very 

general approach to storing and using complex Information. If 
be expressed In some standard mathematical 
e predicate calculus), then all of the work 
on theorem proving could be utilized to make 
ductlve system. By expressing a question as a 


question 

Informatlo 


character 


leduce the Information needed to answer any 
:ould be expressed In the formalism. Complex 
easily useable In limited logic systems could be 
I In the predicate calculus, and a body of work 
on computer theorem proving. This led to the 
tlve" approach to language understanding programs, 
programs used logical systems less powerful than 
:ate calculus (see <Ber-HI!lel>, (Coles 1968>, and 
>ut the big boost to theorem proving research was 
t of the Robinson resolution algorithm <Roblnson>, 
'complete uniform proof procedure" for the first 

omatle theorem proving program with two Important 
first, the procedure Is "uniform" — we need 
:, cannot) tell It how to go about proving things 
to particular subject matter. It has Its own 
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program." UGreen 1S69> p.SJS). In newer programs such as QA4, 

thaorem-provlng mechanisms. It will be Interesting to see how 
close these new strategy languages are to PLANNER, and whether 
there Is any advantage to be gained by putting them In a hybrid 
with a resolution-based system. As to the completeness 
argument, there are good reasons not to have a complete system - 
- these are discussed later In this section. 











S.3-5 Procedural Deductive Systems 

The problem with the limited logic systems wasn't the fact 

programs or procedures. The problem was that these programs 
were organized In such a way that "...each change In a 
subprogram may effect more of the other subprograms. The 

generalize...Finally the system may become too unwieldy for 
further experimentation." (<Raphael 1964> p.91). Nevertheless, 
It was necessary to build In more and more of these subprograms 






capability of using 


procedural Information, but at the same time express this 
Information in a simple and straightforward way which did not 
depend on the peculiarities and special strucuture of a 


particular program or subject of discussion. 

A system which partlelly fits this description Is Woods' 
<Woods 1968>. It uses a quantlfIcatlonal query languege for 
expressing questions, then assumes that there are "semantic 

predicates as (CONNECT FLIGHT-25 BOSTON CHICAGO) and which 
evaluate functions such as "number of stops", "owner", etc. The 
thing which makes this system different from the limited logic 


designed without reference 
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J.S Programming In PLANNER 
3.3.1 Basic Operation fif PLANNER 

The easiest way to understand PLANNER Is to watch how 
works, so In this section we will present a few simple example 
and explain the use of some of Its most elementary features. 

First we will take the most venerable of traditional 
deductions: 


Turing Is fallible. 

usual logical notation and handled by a uniform proof procedure. 
Instead, let us express It In one possible way to PLANNER by 


(THASSERT (HUMAN Tl 

(DEFPROP THE 
(THCONSE < 
THEOREM) 


(THGOAL (HUMAN *?*))) 

This Is one way of saying that a 


The proof would be generated by asking PLANNER 
the expression: 


(THGOAL (FALLIBLE TURING) (THTBF THTRUE)) 


evaluate 


We Immediately see several points. First, there ore two 
different ways of storing Information. Simple assertions are 
stored In a data base of assertions, while more complex 
sentences containing quantifiers or logical connectives are 
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variable In Che pattern, but for the time being let 
cept $? as a prefix Indicating a variable. The 
tlon of the theorem Indicates that It has one variable, X, 
> following THCONSE. 

bird statement Illustrates the function THGOAL, which 
PLANNER Interpreter to try to prove an assertion, 
unction In several ways. If we had asked PLANNER to 
THGOAL (HUMAN TURING)) It would have found the 
assertion immediately In the data base and succeeded 
as Its value some Indicator that It had succeeded). 
FALLIBLE TURING) has not been asserted, so we must 

we will see that a THGOAL statement can give PLANNER 
nds of advice on which theorems are applicable to the 

t causes the evaluator to try all theorems whose 
Is of a form which matches the goal. (I.e. a theorem 
seouent (*7Z TURING) would be tried, but one of the 
PY «?Z> or (FALLIBLE m ITZ) would not. Assertions 
an arbitrary list structure for their format -- they 

pies.) The theorem we have just defined would be 
In trying It, the match of the consequent to the 
cause the variable *7X to be assigned to the constant 













a variable. The data-base searching mi 
command to look for any assertion which matches that pattern 
(I.e. an instantiation), and finds the assertion (HUMAN TURING). 
This causes X (and therefore Y) to be assigned to the constant 
TURING, and the theorem succeeds, completing the proof and 
returning the value (FALLIBLE TURING). 






ms to be something missing. So far, the data base 
only the relevant objects, and therefore PLANNER 
right assertions Immediately. Consider the 
ild get If we added new Information by evaluating 


(THASSERT (HUMAN SOCRATES)) 
(THASSERT (GREEK SOCRATES)) 




assertions: 


(HUMAN TURING) 
(HUMAN SOCRATES) 
(GREEK SOCRATES) 


(THCONSE (X) (FALLIBL 


(THPROG (X) (THGOAL 


$?X») 

there a fallible Greok? 1 ' 

FALLIBLE »?X)(THT8F THTRUE)) 
GREEK S?X>>> 

AND, Insisting that all of It 
THPROG Is happy. Notice what 




the data-base searcher happens to run Into TURING before It 
finds SOCRATES, the goal (HUMAN $?X) will succeed, assigning S?X 


establish the new goal 


TURING), which I: 




Section 














corresponding . 


mechanism f< 
actually thi 


a THPROG, It will succeed, returning os 
t expression, (GREEK SOCRATES). 


PLANNER executive which establishes and manipulates subgoals In 
looking for a proof. 



















THTRUE, which accepts any theorem. 

The filter command for theorems Is THTBF, so a 

((THUSE TH1 TH2XTHTBF TESTHTHUSE TH-DESPERATION)) 
would mean to first try the theorem named TH1, then TH2, then 
any theorem which passes the filter named TEST (which the user 

simple capabilities for choosing theorems -- we do not define 
filters other than THTRUE. However, there Is also a capability 
for filtering assertions In a similar way, and we do use this, 
as explained in section A.5. 







(HUMAN 



























1.3.5 Events and States 

Another advantage In representing knowledge In an 
Imperative form Is the use of a theorem prover In dealing with 
processes Involving a sequence of events. Consider the case of 
a robot manipulating blocks on a table. It might have data of 
the form, "blockl Is on block2," "blocks Is behind blocks", and 



declarative theorem prover cannot accept a statement like (ON B1 


since Its validity will change as the process goes on. It must 

Initial state of the world. See (Green 1969> for a discussion 


(FORALL (HI SXAND (ON * Y (PUT X Y S>> 

(0!KEQUAL Y 2) 

(N0T(0N X 2 (PUT X Y S)>>))) 

In this representation, PUT Is a function whose value Is 
the state which results from putting X on Y when the previous 


human knows that If we haven't touched 2 or W we could just ask 
(ON 2 W S) but In general It may take a complex deduction to 






decide whether we have actually moved them, and even If we 

through the time sequence) to prove they haven't been moved. In 
PLANNER, where we specify a process directly, this whole type of 
problem can be handled In an intuitively more satisfactory way 


by using the primitive function THERASE. 

Evaluating (THERASE (ON STX STY)) removes the assertion (ON 
STX trn from the data base. If we think of theorem provers as 


e operation 


e prover as manipulating tl 
simplifications. Now we ci 
ut any explicit mention of 


DEFPROP THEOREMS 
(THCONSE (X Y Z) (PUT l?X STY) 
(THGOAL (ON *?X S?Z)) 
(THERASE (ON STX $?Z)) 
(THASSERT (ON J?X »?Y>>) 




form (PUT STX STY), we should first find out what thing Z the 
thing X Is sitting on, erase the fact that It Is sitting on Z, 

other things, such as proving that It Is indeed possible to put 
X on Y, or adding a list of specific Instructions to a movement 






complex 






















knowledge of how to deduce things from that state. This Is 
exactly true, and one of the most exciting oossIbl1111es In 
PLANNER Is the capability for the program Itself to create and 
modify the PLANNER functions which make up the theorem base. 
Rather than simply making assertions, a particular PLANNER 
function might be written to put together a new theorem or make 
changes to an existing theorem. In a way dependent on the data 
and current knowledge. It seams likely that meaningful 
"learning" Involves this type of behavior rather than simply 
modifying parameters or adding more Individual facts 
(assertions) to a declarative data base. 
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(THGOAKBIOCK *?X>) 
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loop through a list of objects which are specified by giving a 
PLANNER goal or arbitrary expression which they satslfy. 
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t decide what objects we will have It 
e adopted some conventions for notat 
objects and assertions. Any symbol whlcl 
ents a specific object, while anything 
- name of a property or relation, 
begins with the two participants In thi 
i robot (named :SHROLU>, and the person 
robot has a hand (:HAND), and manlpulat 


eg Inning 






— fMANIP^—jfB 
• HANO l#P' 


'ERTY———| ,C0L0 " 

Figure 54 — Classification of Objects and Properties 













We could use these as simple predicates, and have 
assertions like (•ROBOT ISHRDLU), (•HAND I HAND), and (»PYRAMID 


Is a pyramid. In section 
language programs choose a 
object. In order to do sc 


.k.3, we describe the way the 
English phrase to describe an 




concepts In the above tree using simple p 
used the same form for other predicates, such as colors (for 
example, ('BLUE :B5)), the language generating routines would 

to keep lists and continually check, 
a different way of writing these concepts. 




write (SIS :SHRDLU <ROBOT), (• IS :HAND fHAND), and (MS tB5 


•PYRAMID). 

Looking at the tree, we see that the properties •PHYSOB and 
•MANIP cannot be represented In this fashion, since any object 
having them also has a basic description. We therefore write 
(•MANIP :B5> and (IPHYSOB :TABLE). 

Next, we would like to assign physical properties to those 
objects, such as size, shape, color, and location. Shape and 
color are handled with simple assertions like (SCOLOR :BOX 
•WHITE) and (•SHAPE :B5 *POINTED). The possible shapes are 
•ROUND, *POINTED, AND ^RECTANGULAR, and the colors are fBLACK, 









the scene, their shapes, sizes, colors, and locations. In 
addition to the PLANNER assertions, the system keeps a table of 
sizes and locations for more efficient calculation when looking 
for an empty space to set something down. 
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3.ii.3 Actions 

theoretical 1y be 
The result 
goal requiring m 


- MOVETO, GRASP, end 

ent to the display r 
sent directly to a physic 
f calling a consequent 


F Instructions using the tl 


Involving physical c 


functions. 

n Indicator that the 
hand, and UNGRASP 

and turning on a 

elementary actions. 


/ of actions. Including goals which may 
i of deductions and actions, like 

dlnates or specific motion Instructions, 








anything, trying all of the means It has 
The theorems also do some checking 
to do something Impossible. For example 
the action would not Involve piecing a b 
already an object, and TC-UNGRASP fells 











j.k.k Carrying Out Congnands 

Some theorems, like TC-GRASP, are more complex, as they cai 
cause a series of actions. In this section we will follow 
PLANNER through such an action, using the simplified theorems o 
figure S5. If PLANNER tries the goal: 

(THGOAL ('GRASP :Bl)(THUSE TC-GRASP)) 
the theorem TC-GRASP can do a number of things. It checks to 
make sure :B1 is a graspable object by looking In the data base 

It has nothing more to do. If not. It must first get the hand 
to the object. This may Involve complications — the hand may 
already be holding something, or there may be objects sitting o 




calculations, using I 

calculates where the 


IBSPACE, which 









(DEFTHEOREM TC-CLEARTOP 

(THCONSE (X Y) ( 
GO (THCOND 


•CLEARTOP 




((THASSERT (FCLEARTOP *TX>)>)>> 


(DEFTHEOREM TC-GET-R 


(THGOAL (IPUTON J 


iTABLEHTHUSE T 



(THGOAL (FCLEARTOP S 
(THSETQ $_Y (TOPCENT: 
(THGOAL (FMOVEHAND J 


E TC-MOVEHAND)) 


(THASSERT (FGRASPING S 


TC-CLEARTOP)) 


(THGOAL (‘GRASP »?X) (THU 
(THSETQ S_Z (TCENT J?Y (S 
(THGOAL (PMOVEHAND ill) 
(THGOAL (FUNGRASP) (THUS 
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3.4.S Memory 


programs remember selected parts of their subgoal tree. They do 
this by creating objects called events, end putting them on en 
EVENTLIST. The system does not remember the detailed series of 
specific steps like fMOVEHAND, but keeps treck of the lerger 
goals like (PUTON end fSTACKUP. The time of events Is measured 


any motion occurs. The theorems which want to be remembered use 
the functions MEMORY and MEMOREND, calling MEMORY when the 
theorem Is entered and MEMOREND when It exits. MEMORENO causes 

with an arbitrary name (chosen from El, E2,...>. Recall from 


Section 3.1 that a relation 



Instead of lest as described In 3.1 for unlmportent technical 
reasons which will be changed In later versions. 

In addition to putting this assertion In the data base, 
MEMORENO puts Information on the property list of the event name 








tree which Is being remembered. The reason 











the linguistic part of the system Is a special symbol meaning 
"because you asked me to". MEMORY Is called at the beginning of 
a theorem to establish the start time and declare that theorem 
as the "reason" for the subgoals It calls. 



(THOOALCfPICKUP tBl>>, and It Is Interpreted as a cormand. How 
can we ask “Old you pick up iBl?"? When the robot picked It up. 

Therefore If we ask PLANNER 
(THPROO(X) 

(THGOAL (fPICKUP |TX :B1))> 

It will find the assertion, binding the variable X to the event 
name E2. Since the property list of E2 gives Its starting and 
ending times, and Its reason, this Is sufficient Information to 
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k.l What Is Semantics? 


ii.l.l the Province of Semantics 


and 1Ingulsts al 
and the problem 


of just defining "semantics" 




and "meaning" have 




complete not 
understand In 

syntactic an 



we need a transducer which can work with a syntactic analysis, 
and produce data which Is acceptable to a logical deductive 


In the preceding chapters we have described the two ends of 
a language system -- a syntactic parser with a grammar of 
English, and a deductive system with a base of knowledge about a 
particular subject. What does our semantic theory have to do to 













Pate 


word which allows It to be Integrated Into the system. In the 

meaning of a word (or syntactic construction) which are attached 
to It as Its dictionary definition. 

The formalism for definitions should not depend on the 
details of the semantic programs, but should allow users to add 
to the vocabulary In a simple and natural way. It should also 
be possible to handle the Quirks and Idlosyncracles of meaning 




different words and syntactic features play In this meaning. 


Interpreted In Isolation. It Is always part of a context, and 
Its meaning Is dependent on that context. A theory should 
explain the different ways In which the "setting” of a sentence 
can affect Its meaning. It must deal both with the linguistic 
setting (the context within the discourse) and the real-world 
setting (the way meaning Interacts with 
1Inguistlc facts.) 










fr.1.2 The Semantic System 





























P«ge 

























referring to a parti 


for describing objec 
relationship between 



the word "right" Itse 
semantic Interpretatla 


object which Is a roof. But If we say 
t of the box", we are not referring to 
Is a "right". The normal NG mechanism 
being used Instead to describe a 


pedal 1st to recognlte ti 


able to anticipate a 


and more patched. It will become harder 


an cause the right things to happen In 
without changing the system. This Is 







use for referring back to previously mentioned nouns. It could 
not be defined by a simple format, as could “block" or "dog 11 , 
since It Involves complex decisions about what Is really being 
referred to, and needs access to the previous discourse. In our 
system. Its definition as e noun Is compatible with the 
definitions of all other nouns — the semantic specialists don't 
know anything about It. When the NG specialist Is ready to use 
the definition of the noun. It cells It as a program. In the 
usual case, this program sets up a standard data structure. In 
the case of "one". It calls a heuristic program for 
understanding back-references, and Its effect on the meaning 
will depend on the discourse. Similarly, the verb "be" Is 
called like any other verb by the semantic specialist, but In 


different u 


meanings of words gives 


a flexibility which allows these exceptional words to be handled 




Page 


aa well as Che more ordinary forms. At the same time. It 
provides a strict test of representations of procedures for 
particular words, since the procedures can actually be run I 







This could be treated as a syntactic ambiguity In the deep 

semantic ambiguity Involving the time reference. 

In describing the grammar It was pointed out that we do not 
carry forward simultaneous parsings of a sentence. We try to 









Some semantic theories <Fodor> are based almost completely 
on this Idea. We would like to use It for what It Is -- not a 
complete representation of meaning, but a rough classification 
which eliminates fruitless semantic Interpretations. Our system 
has the ability to use these "semantic markers" to cut down the 
number of semantic Interpretations of any phrase or sentence. 

A second method used to reduce the number of different 


semantic Interpretations 




pile up all possible Interpretations 
inee, then try to make logical sense of 
As each phrase Is completed. It Is 

In context we do not keep the two different possible 
Interpretations In mind until the utterance Is finished. We 
Immediately look In our memory to see which Interpretation Is 
meaningful In the current context of discourse, and use only 
that meaning In the larger semantic analysis of the sentence. 
Since our system allows the grammar, semantics and deduction to 
be easily Intermixed, It Is possible to do this kind of 
continuous Interpretation. 

Finally must deal with case, where -e cannot eliminate 




particular Interpreta 

be enough. The 
plauslbl11 ties 

either "directly o 


slglning a plausibility factor t< 


e multiple Interp 


methods used for 




plausibilities o 


heuristics wl11 

simply guessing 










k. 1.5 Discourse 

At the bee Inn I ns of our discussion 
discussed why a semantic system should * 
"settin#" on the meanlne of a sentence, 
account for three different types of coi 
First, there Is the local discourse 


semantic theory ca 

ntext, which cover 


the discourse Immediately preceding the 
Important to semantic mechanisms like pr 
ask the question "Did you put it on a gr 
"How many of them were there then? 1 ', we 
possible to fill in the missing Informa 
discourse. There are a number of specla 


f information, a 


un reference. If we 
one?" or "Hhi?" or 


mechanisms for using 


in nveral1 discourse context. 


differently depending on whether he I 
sociology. There must be a systematl 
effect of general subject matter on u 
to the effects of general subject on 


things being discussed. If we . 
say "The government Is corrupt." 
"the government of Argentina". 


cussing mathematics or 
to account for this 
tending. In addition 
Ing between meanings 
xt of particular 


g about Argentina, and 
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not be clear which one is meant. But if this Immediately 
follows the statement "There Is o block and a pyramid In the 


box.", then the reference Is to the pyramid In the box. This 


e two. Therefore t 


the local discourse of pronoun reference 
must deal with all of these different fo 


been several sentences 
different problem than 
. A semantic theory 
rms of overall discourse 




not only such things as 
y alter the parsing of the 






















Its sensibility. 

parsing dlrectly. 


Information about 























contain 
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k-7.1 Object Semantic Structures 

describe objects. First, we need the actual PLANNER 
which will be used In deduclns things about the objects, 
like a red cube" can be described uslns the formalism c 


Chapter S 




(THGOALOIS *7X1 f BLOCK) ) 
(THGOALI'COLOR *7X1 SRED))) 
i7 — Simple PLANNER Description 


The variable "XI" represents the object, and this 
description savs that It should be a block. It should h 
dimensions, and It should be red. (See section 3.A for 
details of representation). A phrase such as "a red cu 
supports three pyramids but Is 
more complex description. This would 
descriptions for the various objects. 


(THPROG(Xl) 

(THGOALIfIS *7X1 fBLOCK)) 

(THGOALlfCOLOR *7X1 «RED)> 

(THFIND 3 *7X2 (X2) (THGOALIfIS *7X2 fPYRA 
(THGOAL(fSUPPORT *7X1 

(THN0T(THPR0G(X3) 

(THGOALI*IS *7X3 *BOX>) 

(THGOALI*CONTAIN *7X3 *7X1))))) 
_Flture 58 — PLANNER Description 
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definition 



Section 




these semantic markers to each OSS. The BLOCKS world uses the 
tree of semantic markers In Figure 59. 

which vertical bars represent choices of mutually exclusive 
markers, while horizontal lines represent logical dependency. 
The symbol "fPHYSOB" means "physical object", and "fMANIP" mea 
"manlpulable object". The word "cube" refers to an object wit 
the markers (fTHING fPHVSOB fMANIP fBLOCK). lie shouldn't nee 
to mention all of these In the definition, since the presence 
•BLOCK Implies the others through the logical structure of the 


The definition of the noun "cube" Is then: 

(NMEANS((f8L0CK)((lIS *•• fBLOCK)(f EQOIM •••)))) 

NMEAKS Is the name of the function for dealing with nouns, 
and It accepts a list of different meanings for a word. In th 
case, there is only one meaning. The first part of the 
definition Is the marker list, followed by the reduced PLANNEB 
definition. When NMEANS Is executed. It i 
onto the semantic structure which Is belni 
It takes care of finding out whet markers 
tree, and deciding which predicates need 1 


this Information 
It for the object. 
Implied by the 

predicates (like 


• EQOIM) . We wl 
recommendation 1 


e PLANNER goals, t 






















('COLOR 


Its the definition for the adjective "red", 
definition to Include the PLANNER assertion 
and Indicate chat It applies only to physical 
la the same format used for nouns, defining 


(NMEANS((fPHYSOB)(('COLOR ... 'RED)))) 
Notice that there Is no distinction mat 
'PHYSOB here to Imply "applies < 
use of 'BLOCK In the definition 
block". This Is because of tht 

mean "this definition applies or 


physical objects" 


definition Is Interpreted t 


the object". Since the noun Is th 
markers cannot possibly conflict, 

designed so that w. do not need to limit ourselves to , ,|„*,. 
tree — we could classify objects along several dimensions, and 


e markers already established fo 


e marker programs a 


For e 


classify objects b 


The order of analysis 
use of "relative" modifiers 
absolute definition for "bl 
still not much competition 


modifiers Is quite netural to the 
It Is Impossible to give an 
or "little", since a "big flea" Is 
r a "little elephant". The meaning 





of the adjective Is relative to the noun It 
It may also be relative to the adjectives follow 
A "bis toy elephant" Is on a scale of Its own. 
analytes the MR from rlsht to left, the meanlns 
adjective Is added to the description already b 
head and modifiers to the right. Since eacl 
program. It can just as well be a program wl 
description (both the semantic markers and 
description), and produces an appropriate meanl 
the object being described. This might be 
absolute measurement Ce.g. a "big elephant Is 
tall) or can remain In a relative form by produ 
expression of the form "the number of objects 
description and smaller than the one being des 
than the number of suitable objects bigger tha 
In adding the meaning of "red" to the sem 
the specialist must make a choice In ordering 
expressions. We remember from section 2.S the 
expressions can be Important, since variable a 

shown In Figure 60, PLANNER will look through 

the second. It will look through all of the ri 








e would certainly b 


n looking through a 


(THGOALl'COLOR S 


'COLOR) to have associated with It a pro 
evaluate Its "priority” In any given env 
might be as simple as a single number, w 
relation always has this priority". It 
be a complex heuristic program which tak 
current state of the world and the dlscu 
definitions, we have adopted the simpler 
fixed priorities In the range 0 to 1000 
track of the priority of the expression 
the PLANNER description, the function NM 


bltrerlly. By keeping 

e whether 








HEQDIM $?X1)) 

(0 SBLOCK »MANIP #PHYSOB * 
(•MANIP fPHYSOB STHING) 




determiner 

ordlnel 


lost of the parts of this structure (celled an QbitRt 
Semantic structure or OSS) hove already been explained. The 
PLANNER description Includes a variable list (we will see Its 
use later), the priority of the first expression, and a list of 
PLANNER expressions descrlblnK the object. The "markers" 
position lists all of the semantic markers applicable to the 
object. The 0 at the beginning of the list Is the 
"plausabl11ty” of this Interpretation. This factor was 
discussed In section b.l.k, and Is set when we are faced with 
more than one possible Interpretation of a word. Each semantic 
structure carries along with It an accumulated plausablllty 
rating. This will remain 0 unless It Is set specifically by an 
ambiguity. 

The "systems" position Is a list of all of the nodes In 

one) which have already had a branch selected. It Is used In 
looking for marker conflicts. The "variable" Is the variable 










the ordinal. These a 


t this object. The system generates It 
.... providing a new one for each new 
a positions left are the determiner and 
explained In section a.2.a 






L.2.2 Relative ClgMSM 

Let us now take a slightly more complicated MG, "a red cube 
a pyramid," and follow the parsing and semantic 
G parsing program finds the determiner 
, and noun ("cube"). At this point 
ites the structure d 


which supports a 

("a”), adjective ("rei 
SMNG1 Is called and c 


t finished w 


previous section. Notice that th 
Is called — It has only reached a point where we can 
analysis. At this point, the MG might be rejected .1' 
further parsing If the combination of noun, elasslflei 
adjectives Is contradictory to the system of semantic 
Neat the NG program looks for a qualifier, and c 


CLAUSE part o 




E CLAUSE RSQ). 


RSQ (rank shifted qualifier) Informs 

for a VG, succeeding with "supports" 
own semantic specialist to analyze tl 
clause, but we will Ignore this for 
Is transitive, the CLAUSE looks for 
program. This operates In the same 
semantic structure to descrll 
"pyramid" Is: 

(NMEANS((*PYRAMID)<C#IS 


e CLAUSE program that It 

The VG program calls Its 
time reference of the 
or now. Next, since "support" 

me way as before, producing a 
pyramid". The definition of 

SPYRAMIO)))) 
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define ver 

physical o 




the first CLAUSE specialist Is called to 

Imple way, as we do nouns and adjectives, 
he "If the subject and object are both 
hen "support" naans the relation ISUPPORT 
t order". This Is written formally using t' 

PHYSOBUt (SPHYSOB)))(^SUPPORT ♦! *2>MIL>> 


e Important 


parts are the semantic marker lists for the objects 
participating In the relationship, and the actual PLANNER 
expression naming It. The symbols "fl" and "*2" (and “fj" If 
necessary) are used to Indicate the objects, and the normal 
order Is 1. semantic subject (SMSUB) 2. semantic first object 
(SM0B1) 3. semantic second object (SM0B2). Notice that we 

have prefixed the word "semantic" to each of these. In fact, 

objects of the clause. In this example, the SMSUB Is the NG "a 
red cube" to which the clause Is being related. SMCL1 knows 











- Relation Semantic Structure 1 


description to which this clouso serves as a modifier. Me will 

The "relation" Is the material for PLANNER to use, and "neg" 
marks whether the clause Is negative or not. 

The last element Is a set of semantic markers and a 
priority, just as we had with object descriptions. 

Relationships have the full capability to use semantic markers 
just as objects do, and at an early stage of building a relation 
structure. It contains a PLANNER description, markers, and 
systems In the Identical form to those for object structures 
(this Is to share some of the programs, such as those which 
check for conflicts between markers). We can classify different 
types of events and relationships (for example those which are 
changeable, those which Involve physical motion, etc.) and use 
the markers to help filter out Interpretations of clause 
modifiers. For example, the modifying PREPO "without the 
shopping list" In "He left the house without the shopping list" 
has a different Interpretation from "without a hanvner" In "He 
built the house without a hammer." If we had a classification of 
e Involving motion and those using 


activities which Included t 








relationships 
the definition 
therefore cont 
definition Ind 
replaced by a 


the relation, 
onto the PUN 

description o 


only the pieuslbl11ty, 

of markers If they were 
now finished, and th 
called. Its task Is 
UIINEH descriptions o 

h the relation Itself, a 
ascription of the object to w 


specialist on relative 
to take the Information 
the objects Involved In 


different objects (particularly on their 
this case. It Is relatively easy, and the 
red cube which supports a pyramid" becomes! 
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(THGOALCACOLOR J 


(THGOAUASUPPORT J 


0 ABLOCK AMAH IP APHYSOB f 


The only thing which ha 
description, which now holds 
Its variable list contains b 


Is the PLANNER 
e necessary Information. 


relation, which has been combi 
descriptions for the objects, 
relative clause works with oth 








<i-?.3 Proposition EfBUEa 

bs and qualifying prepositional phrases are very 
ueture and meaning. In fact, their semantic 
most Identical. The definition of a preposition 
ses the same function as the definition of a verb 
saying "If the semantic subject and object are 
il objects, then the object Is fABOVE the subject" 

(Remember 
vertical 
formaliz 
CCME 




(fPHYSOB))((fPHYSOB)))C fABOVE # 


i preposition 




qualifier, the SMSUB Is the HO of which the 

situation may be more complex, 
itence like "Who was the antelope I saw ye 
<e SMOBJ of the PREP "with" Is the questlc 
MAJOR CLAUSE. However, the PREPG 
MPREP) takes care of all this, and In defining a 

■n defining "above" instead of "under' 




relation 









would have been ('ABOVE *1 #2) Instead of CfABOVE <2 #1). if 
the PREPG Is an adjunct to a CLAUSE, the SMSU8J Is the RSS 
defining the CLAUSE. The definition of a preposition can then 
use the semantic markers which are Included In an RSS. 






4.2.4 Types af Object Oescrlptlons 

In the examples so far, all of the objects described have 
been slntular and INDEFInlte, like "a red cube", and the 
semantic system has been able to assign them a PLANNER variable 
and use It In building their properties Into the description. 

Let us consider another simple case, a OEFInlte object, as In "a 


The analysis begins exactly as It did for the earlier case, 
building a description of "red cube", then one of "pyramid." 

The "pyramid” description differs from OSS 2 In having OEF In 
place of INDEF In Its determiner. This Is noted at the very 
beginning of the analysis, but has no effect until the entire NG 
(Including any aualiflers) has been parsed. At that time, the 
second NG specialist SMNG2 checks for a definite NG and tries to 
determine what It refers to before going on (we have pointed out 
In various places how this Is used to guide the parsing). It 
takes the PLANNER description which has been built up, and hands 
It to PLANNER In a THFINO ALL expression. The result Is a list 
of all objects fitting the description. Presumably If the 
speaker used "the", he must be referring to a particular object 
he expects the listener to be aware of. If more than one object 
fits the description, there are various discourse heuristics 
used to find the reference, (see Section 4.3.5) and If nothing 
succeeds, a failure message Is produced and the parser has to 
back up and try something else to parse the NG. 
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puts It Into the description 
relates the descriptions to b 
which supports the pyramid" I 


object being referred to. It 
the property list). When SMRSO 

tes advantage of this. The 


object found will have a proper name like IBS. Instead of 
buildi ng the PLANNER description of OSS 3, It builds: 

((XI) 200 (THGOALt'IS $7X1 'BLOCK)) 

(fEQDIM 57X1) 

(THGOAK'SUPPORT 57X1 : BS))) 

Flguro 65 — PLANNER description 1 

a red cube which supports the pyramid" _ 

The object Itself Is used In the relation rather than dealing 
with Its description. 


parameter, as shown 


sited about a red cube which supports three 
ase the PLANNER description would Include 
he function TMFIND with a numerical 

t two pyramids", a fancier THFINO p, 


satisfied If you don't find any, but If you find J, 1-me.dl.t.ly 
cause a failure." In addition to numbers, the SMNG1 and RSQ 
programs can work together to relate descriptions of quantified 
objects. "A red cube which supports some pyramid” Is handled 
just like the original Indefinite case. "A red cube which 
supports DSL pyramid" and "a red cube which supports every 
pyramid" are handled using the other PLANNER primitives. A 
universal quantifier is translated as "there Is no pyramid which 



(TH60AL('SUPPORT S2X1 : 


(THGOAK'SUPPORT S?X1 *?X2>>) 


(THGOAK'SUPPORT SJX1 S 


(THPROG (X2> (THGOAK* I 


(THGOAK'SUPPORT J 


(THPROG (X2> (THGOAK'I 


(THGOAK'SUPPORT JTX1 * 





f PLANNER, 

or even of the way we have set up our semantic programs. It was 
done as a convenience, and will be changed when the system Is 
expanded to discuss universal statements as well as the specific 
commands and Questions It now handles. 

We similarly handle the whole range of quantifiers and 
types of numbers, using the logical primitives and THE I NO 
parameters of PLANNER. The work Is actually done In two places. 
SMNG1 takes the words and syntactic features, and generates the 
“determiner" which was one of the Ingredients of our semantic 
e for objects. The determiner contains three parts. 

either NS (singular, but not with the 
“>, NPl (plural with no specific number), 
e fish"), or a 


construction contalnl 
either be the number 
"exactly". Thus the 


luce the Identical determiner, containing " 


r the question t 
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Ordinals 

ADJectlves. 


are treated specially. 


ong with superlative 



d get the PLANNER description: 


(THGOALKIS $?X1 (BLOCK)) 

(THGOAL((IS J7X2 (PYRAMID)) 

(THGOALKSUPPORT J7X1 S7X2)) 

(THAND(THGOAL((IS S?XJ (BLOCK)) 

(THGOALt(IS $7X4 (PYRAMID)) 

(THGOAL((SUPPORT 17X3 *?X»)> 

(THGOALI(MORE (SIZE J7X3 <7X1))))) 

Fleu re 68 — PLANNER Description 2 
the biggest block which supports a pyramid" 
type of description Is generated for other 












li-?-S The Meaning al Ones lions 

So far, we have discussed the 
relationships which are used to describe 
groups and relative clauses. Now we will 
meaning of a sentence as an utterance — 




e Is analyzed Into a 

storing some knowledge, 
let us look at Questions. In describing the grammar 
(see section 2.3.5) we pointed out the similarities 


question, or a command. The sen 
relationship semantic structure, 
by responding, taking an action. 


of the system network and the parsing program. They also have 


much In common on a semantic level, 
questions as being a relative clause 





> a NGQ question, whose question element 
"Mhlch red cube supports a pyramid?" Is 


pyramid. The system can answer sue 
clause to the object, and building 
which supports a pyramid." It then 


a question by relating the 
description of "a red cube 
akes this entire PLANNED 


description and puts It Into a THFIND ALL statement, which Is 
evaluated In PLANNER. The result Is a list of objects fitting 
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course PLANNER might find several objects or no objects meeting 
the description. In this case we need answers like "none of 
them" or "two of them". Section h.U describes how responses to 
questions such as these are generated, depending on the relation 
between the specific question and the data found. If the 


w many" Instead < 


through the 


Identical process, 
the objects found. 




No matter what type of NGQ we have (there Is a tremendous 
variety — see section 2.3.J) the same method works. We treat 
the MAJOR clause as a relative clause to the NG which Is the 
question element, and which we call the focus. This Integrates 
the relationship Intended by the clause Into the description of 
that object. PLANNER then finds all objects satisfying the 
expanded description, and the results are used to generate an 


"how". In these cases the focus Is on an event rather than on 


f the relation, 
re referring to i 
ry as (fPICKUP E! 


the object picked up, and E23 Is the arbitrary name which was 
assigned to the event (see Section 3.4 for a description of the 
way such Information Is stored.) We can ask In PLANNER: 
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$?PLACE (PLACE EVENT) 

(•PUT STEVENT :OBJ STPLACE))) 


The ADJUNCT case Involves chinking about a special 


•LOCATION 


(THFIND ALL S7PLACE (PLACE EVENT) 

(THGOALf(MEET S?EVENT :VOU :HIM)) 

(THGOAL(* LOCATI ON JTEVENT STPLACE))) 





'ed away from the BLOCKS world since 
actions In Its vocabulary which 
Ithout that place being mentioned In 


perfectly capable of handling such cases 


pretending they are a relative to soma object, event, or place, 
and by adding the relationship to the description of this focus 
It Is an Interesting fact about English that even In a YES-NO 
Question, where there Is no question element there Is usually a 
focus. Consider a simple Question like "Does the box contain 
block?" Someone might answer "Yes, a red one.", as If the 
question had been “Hhlch block does the box contain?" Notice 

Something about "the box" makes It obvious that It Is not the 
focus. It Is not Its place as subject or object, since "Is a 




a block" Instead o- 





about it specifically, t 

object. In answering " 

does the box contain?", 
box" to the description 
objects meeting this dei 
Is different for the twi 
Is sufficient, while In 
deduction needed to der 
uses this extra Informat 


contain a block?", our 
lo with "How many blocks 
relation "contained by th 


pes of question. 


Is Identical. In 
y replying, "Yes, 


question-answering. It 
telling the questioner 
n knowing, even when h 


o determine tl 


asking a question, people are usually focusing their , 
on a particular object or event. There are a number 
for Indicating the focus. For example a quantifier. 
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focus, since it Is the subject while "table" Is Inside a PREPS. 
Our system contains a heuristic program which takes Into account 
the kind of determiners, number features (singular Is more 
likely than plural), syntactic position, and other such factors 
In choosing a focus. If It Is In fact very difficult to choose 
in a given case. It Is likely that the speaker will be satisfied 


stagecoach?", a possible ans 

0." This Is closely parallel 

some questions which have no 
clauses with only definite n 


swer. Interpreting the 
yesterday, last week, 
to answering questions 


be expresssed 
variables. 


The NG analysis finds the actual objects referred to by a 
definite NG, and these are used In place of the variable In 












t| - 2 - fi Interpret trig Imperative 


ese are handled somewhat differently 
questions. If they contain only definite objects, 
treated In the way mentioned above for questions wl 
The command "Pick up the red ball.'*. Is translated 
relationship HPICKUP iB7) which can be evaluated d 
puttlnf It In a THOOAl statement which will carry o 


(THGOAL (fPICKUP :87)(THUSE TC-PICKUP)) 

different. We could first use THFIIIO to find a r 
put this object In a simple goal statment as we dl 
red ball". This, however, might be a bad Idea. I. 
red ball arbitrarily, we may choose one which Is 01 
which Is supporting a tower. The robot might fall 
to do a lot of work which It could have avoided wl 
thought. 

We wont to send the theorem which works on th< 
description rather than an object name, and let thi 
choose the specific object to be used, according t< 


relationship. 


Before a clause 


s objects, these ai 







trlctic 

crlptio 


e "Pick up a red ball", It will actually 
ibS) where NG45 names an OSS describing "a 
:hls directly as a goal statement, calling a 
ch knows how to use these descriptions. The 
•orem named TC-FINDCHOOSE, which uses the 
object, along with a set of "desirable 
oclated with objects used for trying to achieve 
ay specify that It would prefer picking up 
doesn't support anything, or which Is near the 
location. Each theorem can ask for whatever It 
ie, It may be Impossible to find an object which 
requirements, and the theorem has to be 
Ihat It can get. TC-FINDCHOOSE tries to meet the 

In the case of plural). It gradually removes the 
It must always keep the full requirements of the 
it In English In order to carry out the specified 
shot simply tries to be clever about choosing 



















In our system we have four different ways In which 
Information can be accepted In a declarative sentence. The 
first Is a simple word definition facility. If we say "A 'marb' 
Is a red block which Is behind a box.", the system recognizes 
that we are defining a new word. It currently recognizes this 
by the quote marks, but It could just as easily declare all 
unfamiliar words as possible new words. We have not done this 
as It would eliminate the feature that the system lesnedlately 
recognizes typing errors without waiting to begin parsing the 


generate a new dictionary entry for the word, defined 
syntactically as a noun, and with Its semantic definition being 
the program "set the object description to this one we saved 
earlier." Remember that all definitions are programs, to this 

of the description. It simply Inserts the description used to 
define It. If we talk about "two big marbs", the system will 
build a description exactly like the one for "two big red blocks 


assertions Involving 


of Information the system accepts Is simple 
As we mentioned In Section 3.A, the system 




has complete data about the physical characteristics of the 
objects In the sceoe. We have selected ALIKE as an arbitrary 
relation about which the system knows nothlnc except what It Is 
told In the dialog. If we say "I like you." this produces the 
assertion (HIKE : FRIEND iSHRDLU) (the name of the robot Is 
iSKRDLU) which Is simply added to the data base. The system 
also plays a trick with the adjective "nice". Instead of having 

eally saying more about the speaker 
efIn It Ion of "nice" is 
I FRIEND •*•))>> 


describing something 

(I1MEAIJSC (f THING) ((#L 


object he was referring 

blocks.", the system 
simple PLANNER 


(THGOAL {fCOLOR $7*1 fRED))) 
heorem says "Whenever you want t. 
hlng, you can do It by proving t 


out deductions Involving 
s universal Quantification. 









blocks", or (wrongly) "a 




possible 


extensions of the system. 




n almost Identical 


(THCONSE (XI) 

(•LIKE tFRIEND «?X1> 

(THOOAL («IS S?X1 *BLOCK)) 

(TMflOAl (•COLOR S?X1 •RED))) 

(THFAIL THOOAL)) 

this theorem Is called just like the one above. But 

succeed. Instead, It uses the PLANNER function THF 
powerful way. Instead of just causing that theorem 
causes the entire goal to fall, regardless of what o 
theorems there are. We can also accept a sentence 1 


positive N6 
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4■2■a Time 


One of the most compleg parts of English semantics Is the 
way of establishing temporal relationships. It was pointed out 
earlier that one of the primary differences between the clause 
and other units such as the NO or PREPO Is the special set of 
mechanisms within the clause for handling time. In this section 
we will describe how those mechanisms operate both within the 


In our formalism for describing relations and events (see 
section 3.1) there Is provision for Including a time reference 
In a relation. The sentence "Harriet saw the film last week." 
might be represented as 

(•SEE :HARRIET :FILM :TIME23) 

where :TIKE23 Is an arbitrary name for a structure describing 
the time reference 'Mast week". The semantic programs for 
dealing with time can be described In three parts — the form of 
structures use< 


created, and the way they are used In understanding and 
deduction. 

A. Time Semantic Structures 

For the purposes of our BLOCKS world, we have treated only 
a simple part of the overall range of time references In 
English. In particular we have dealt only with references to 
actual events which have happened In the past or are occurring 
In the present, without dealing with the many varieties of 






future events, possible e 
this simplification the s 


ts, conditional event! 


a clock), relating a 


o specific numerical 


single time -- It may continue for a period of time during which 
other events are occurring. 

English makes a clear distinction between events which are 
thought of as occurring at a particular time, and those which 
are pictured as continuing over an Interval. This contrast Is 
expressed both In the choice of verbs and In the shape of the VG 
containing the verb. 

Verbs like "like", and "know", are Inherently progressive. 
They express a relationship which continues over a period of 
time. Verbs like "hit", and "write" are not progressive, but 
Indicate the completion of an action as a whole. Of course, 
this action also Involves a process, and there is a way to 
..press this aspect by using a tense PRESENT IN... The sentence 
"I broke It." Is not progressive, giving the feeling of a single 
momentary act. "I was breaking It." emphasltes the process of 
breaking, to which other events can he related. 

In the present tense, the distinction Is clear. The 
present of a progressive verb has the expected meaning, as In "I 
know your name." With a non-progressive verb, there is a special 
meaning of habitual or repeated action, as In "I break bottles." 
In order to produce the meaning usually considered "present". 
















Setting up Time Structures 
Time Semantic Structures are associated w 
w one Is generated each time a clause Is par 
e determined by different aspects of the clause s 

'rm of the VG, the progresslvlty 
nd the specific verb, and the limits 
s bound clauses, adverbs, and time 


e depends o 


t by modifiers si 


No analysis Is done until after the VG Is parsed and I 
tense established. Some types of secondary clauses such as 
SUBING, TO, and SUBTO do not Indicate a tense. There Is a 
potential ambiguity In determining the time reference. "Th 
sitting on the table baked the bread." might Indicate that 

Unless there Is a specific reference (like "the man si 
on the table yesterday...'*) the system should take both 
possibilities Into account and resolve them as It would an 
ambiguity caused by multiple senses of words. The current 
system does not do this, but uses a simplifying heuristic, 
the secondary clause Involves PAST, and Is embedded In a PA 
MAJOR CLAUSE, the two times are assumed the same unless 
specifically mentioned. If the secondary clause has no ten 
It Is assumed PRESENT. If It Is PAST, but Imbedded In a PHI 
MAJOR CLAUSE, the system checks the time reference of the 




be the same (Including 
eoplled), If not It si 

with no beginning limit, and an end limit of :NOW. 
tense TSS Is represented by the single atom iNOW, wh 
treated specially by the programs, and Is often dele 
relations which Interrogate the current state of the 
(see below). It can be applied only to progressive 
tenses (no provision exists for understanding habitual action). 

Modals are treated like present tense as far as 
establishing time references. A more complete system would 
account for future, different types of modals, more complex 

finding the referents 


like "yesterday" and TIME NO's llk< 
both limits. This can also be dom 
you were building the stack" or PRI 
Other clauses, prepositions, and g 
(Ilka "after you hit It", "after t 
"before" and "until") set the end 


y modifiers. Adverbs 













k?" Is answered by first finding the even 

ns the beginning and ending of that event 
In the relation fPICKUP. 
re ere discourse phenomena which Involve 
here are specific back-references with wo 


re bulldlng 
of building 
r limits), 
as limits for 


major time reference of the previous sentence, and substitutes 
It In the current sentence whenever such phrases are used. This 
time Is also carried forward implicitly. Consider "Did you pick 
up a red block while you were building the tower?" "No." "Did 


you pick up a green one?" In this sequence, the 
Involves a specific time interval although It Is 


not mentioned 





not have any explicit time reference, the previous 
. Long dialogs can appear In which the some time 
used throughout, but Is mentioned only In the first 


So far, all of our discussion haslnvolved the clause with 
Its verb group and time modifiers. But In making use of time 
Information we must handle other units a. well. The sentence 
"The man sitting on the table baked the bread." has two 
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these details using syntactic Information. 

In our approach, these can be seen as semantic ambiguities 
which arise within a single syntactic structure. Part of the 
semantic definition of the word "millionaire" (or "student", 
"bachelor", etc.) Involves a reference to time. Within the 
language for writing semantic definitions, there Is a special 
symbol •TIME. Whenever the program for the meaning of a word In 
the dictionary Is called, the semantic system will have 
determined the appropriate Time Semantic Structure (or 
structures) and have assigned a value to this symbol 
accordingly. If the time reference Is ambiguous, the definition 
will be called once for each possibility. The noun millionaire" 
might be defined: 

(NMEANS (((PERSON) ((* IS ••• fPERSON) 

(•POSSESS ••• Jl,000,000 •TIME)))) 
Notice that not every relation Involves time. 8elng a 
ERSON Is assumed to be a permanent characteristic. If the 
me Is PRESENT (Indicated by the TSS :N0W), the system deletes 
e time reference, so PLANNER will receive the expression 
HGOAl (.POSSESS t?Xl $1,000,000)), where i?Xl I, the variable 
assigned to the object being described. If the sentence were 
the war, many millionaires worked In restaurants.", the 
ference of the sentence would be a structure like ( 

NIL 19kl 1905), and the PLANNER e 
"millionaire" would Include: 

(•POSSESS $7X1 $1,000,000 












itj.a.9 Semantics af Conjunction 




In a simplified way — noun groups, adjectives, RSQ clauses, 
MAJOR clauses which are not Questions. The distinction b.tw< 

With MAJOR clauses, the conjunction must be "and", and 
components are processed as If they were completely separate 
sentences, except that the response ("OK." for IMPERatlves, 

"I UNDERSTAND." for DECLARatlves) Is supressed for all but t 
last. The system will not accept sentences joined with "or 
or "nor", and will misunderstand compounds which cannot be 

o Individual actions (e.g. "Build a stack gad usi 


of the first constltutent NG, the 


If all of the components are OEFInlte 


and", the conjoined NG Is definite, and Its REFERent Is the 


preposition, the definition of that verb or preposition 




check explicitly for conjoined structures and treat t 
specially. For example, "touch" can be defined so t 
sentence “A and B are touching." will be represented 


(•TOUCH :A :B)). If there Is no special cheek, the system 
assumes that the desired object Is the list of referents, 
and 8 support C." would produce CTHGOAL (»SUPPORT (tA :B) 
If the first element of the PLANNER expression (usually tl 
of a predicate) has a property MULTIPLE on Its property II 
the system modifies this to create the expression: 


(THAND(THGOAL(»SUPPORT : 
(THROALI•SUPPORT 1 


,ND( THGOALI fsurrUK I iu _ 

(THGOAL('SUPPORT IB :C)>> 

f the conjoined NG Is ono of the ar t uments to a compand, 
leorem TC-CHOOSE will choose the specific referents. If 
injunction Is "and". It will combine the referents for esc! 



descriptions 


Implicit THAND. 






(THORCTHGOAK* 


Whenever i 
ambiguous, Che 
amblgulcy, takl 




'BLOCK)) 

.*R- 

•GREEN))) 

ocher modifiers such as 

Che syscem, usually by adding 
and che ocher would recognize 


a conjoined scruccure are 
e simply muldplles Che 
I possible comblnaclons of IncerpreCadons. 








b.?■10 More on Ambiguity 

Section b.l described how Che number of Interpreteclons of 
an ambIguous sentence can be reduced through the use of semantic 
markers, and selection restrictions associated with verbs, 
adjectives, and preposltlons. This section will describe the 
mechanism for producing multiple Interpretations, assigning 
plausibilities to them, and resolving the ambiguities through 
discourse heuristics end Interaction with the user. 


VB, CLASP, or PUT can Introduce an ambiguity Into the semantic 
Interpretation. The remaining classes (such as NUMber and 
DETerminer) have very limited definitions, and are handled 
dlfferently. 

semantic structures, based on Its definition, and the other 
lists of semantic structures to which It Is related. HOUII, 

PROS and PROPN set up lists of Object Semantic Structures. ADJ, 
ADV, ond CLASF take one of these lists, and produce a new list 
adding the modification (and posslblly eliminating anomolous 
combinations). The VB, PREP, ond PRT (In conjunction with VB) 
set up lists of Relation Semantic Structures, and other classes 
can modify these lists. 

Any of these definitions can Involve special programs for 
producing the list of structures. For example the SHIT program 


analyzing pronouns 
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contains a complex set of heuristics and syntactic c 
find the possible referents of a pronoun and set up 
Interpretation for each one. For simpler words, the 
NMEANS and CMEANS have ways to deal with multiple sei 


First, they both take as an argument n 
definition, but a list of definitions, each 
semantic markers, PLANNER expressions, < 
them has mechanisms for looping through e 




subject a 


o produce multiple Interpretations. If the 
id object of a clause each have two Interpretations, 
and the verb has three senses, all twelve combinations will be 
tried, and the resulting list of Interpretations for the clause 
will contain as many of them as pass through the semantic marker 
filters". This Is all done by the function CMEANS without 
mention In the definitions. Third, the definition functions 
have optional ways to establish a "plausibility" rating and 
paraphrase for each meaning. 

In the dictionary, the word "on" has a semantic definition 
which uses the function *0N, which contains: 

(CMEANS ((((fPHYS08)) ((fPHYSOB))) <»0N #1 #2 .TIME) 


((((’PLACE)) ((fPHYSOB))) ( 


e different si 


This contains tl 

e subject be a oleee rather thai 
o, however can be applied to thi 
n be Involved In an ambiguity. 


a physical object. The first 
same objects, and therefore 
ach of them Is given an 
additional argument, to help resolve ambiguities. This argument 
appears after the standard semantic filters, PLANNER relation, 
and semantic markers for the relation. It Is composed of two 
elements - a LISP form to be evaluated for a "plausibility", 

plausibilities are simply numbers. They could just as easily be 
a form like (PLAUSCHECK), which would call a special program 
(defined by the user) which could do arbitrary calculations In 
a plausibility. This might Involve PLANNER 
deductions, checks on the exact syntax of the sentence, or other 


which meaning fits best with the the o 
and the subject being discussed, 
emantlc structure Is built. It takes on the 

es of Its components, as Its own plauslblll 
done to eliminate obvious low plauslbl11 tie 
iuld be a simple addition to the program. A 
are carried along until the sentence Is tot 











the most plausible Interpretation. If tl 

system to respond "I CAN'T". Questions £ 
completely. The system orders the Interprets 
plausibility and finds the answer for the most 
then tries again to answer It, using only Ini 
In the previous sentence and Its answer. If 
finding the same answer. It deducts 500 from 
since It Is unusual to ask a question to which 
Just given, either explicitly or Implicitly. 

In the previous sentence Is not sufficient ti 
system then tries to answer using only Informa 
been mentioned previously In the discourse, 
deducts 200. If the plausibility Is higher 
next Interpretation by a large enough margli 
the user and called TIMID) It gives the ans> 
not. It saves the answer and repeats the prt 
Interpretation. After all Interpretations 
the answers are checked to see If they are I 
case It doesn't matter which Interpretation 






h Interpretation Is a list of those places 
* others. This Is produced automatically b> 
ch accepts multiple definitions (such as NMEANS a 


llfferlng 

: differed 




s" SEs\r.sT‘“ 
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"reasonable" an Interprets 

refers to the book, or the 
bias. It would not be rca 
reason for falling of 

Part of the interpret 


I.", we avoid believing that " 
'as "slanted" by the author's 
onable for either of these to be t 


iks at declarative 
iw "surprising" an 


: be able to evaluate 
Interpretation Is, and to choose the one which fits best 
the normal expectations. Including the hearer's knowledge 
the world. This Is not easy to formalize, and was not 
In this project. It could be extended to lower levels 
sub-units for reasonableness as they are formed, to ave 
carrying multiple Interpretations through the analysis 
entire sentence. It seems clear that people do this, t 
truly Intelligent language-understanding program must t 





i!.2.ii la fi£ and la Hass 


In English, and have a compleg variety of uses. Thi 
the system In two ways. First, In the grammar they 
specially since they can occur as auxiliary verbs, 
would have been going”. In this use, they do not a< 
semantic Information eacept for helping to determine fea 


clauses like "Do you have a match?" and "He la wrong, 
verb, "be" Is handled specially In the grammar since I 
enter Into constructions such as "there Is" which do r 
with any other verb. However, the semantic analyzer < 
know anything special about "be" and "have". Their m. 
Included In their definitions, which a 
like any other verb definitions. 




The use of "be" depends on the specific constellation of 
objects and complements In the clause. The definition Is a 
program containing about kO lines of LISP, which handles those 
meanings relevant to the BLOCKS world (for e.ample. It cannot 
deal with a "role-playing" meaning, like "Laurence Olivier mas 

Sentences with the feature THERE, Involving a construction 
like "there Is" are represented by the PLANNER ekpresslon 


and might 
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r objects which c 


d destroyed, a 


The other meanings of "be" Involve INTensive clauses which 
contain an object and a complement. One definition checks for 
COMPQ questions like "What color Is the block?", to generate a 
PLANNER expression (SCOLOR tBLOCK *?X1>. If the complement Is a 
:k ills bluest object ?" or 


definite N> 


"What Is the bIncest object ?" 
been determined, and Is Inser 
(THAMONO ••• (QUOTE!:0B0))), 
can function In two ways. If 
In the first example, the ••• 


If the subject Is Indefinite, 
It to be assigned to the seme 
If the complement is a PI 


the referent will have already 
led In a PLANNER expression 

the subject Is also definite, as 
will be replaced by Its referent, 

I only If the two are Identical, 
the THAMONO statement will cause 
referent as the complement. 

EPG or a complex AOJG, like 
Is only serving as a place-holder 


e reference. The semantic Interpreter li 


eady set up a relation of the form (»0N 
h Includes the appropriate time reference, 
be" program simply takes the RSS produced f 
uses It as the semantic Interpretation of 


r possl bl titles fi 






3 (e.g. a single adjective), or a new 
word. In the case of a NG, the complement NG contains 
additional Information to be ascribed to the subject, as In a 
large object which Is a xgd block ". The PLANNER description of 
the complement Is stripped from Its OSS, and appended to the 
PLANNER description of the subject. If the subject Is definite, 
as In "Is Aha bluest thins a red block?", the referent Is 
known and can be plugged into the PLANNER description of the 
>e If the description applies. This Is done 
:oncept called fHASPROP which triggers the 

If the complement Is a simple AOJG, the ADJG semantic 
specialist creates Its OSS b, taking the OSS for the subject, 
stripping away the PLANNER description, and using the rest as a 
skeleton on which to place the PLANNER ekpresslon produced by 
the adjective. Once this Is done. It can be treated exactly 
like an Indefinite NG. 

Finally, If the subject or complement Is a new word (as In 

new definition Is created using the function aDEFINE. The 

form of an Indefinite NG, and the new 
s asssumed to be a noun. The semantic definition created 
OSS which was created for the defining 


e definition O' 


English) t 


e limited subject matter 
good approximation. The« 
t apply — "the palntlnt which John I 
rlly the same as "John's painting." 
kes use of the same definition. A me 
d distinguish between the thre 
Involve only simple changes to the semantic 

to Indicate a few different relationships, b 
used to create relationships dependent on th 
the objects Involved. "Sam has a mother." c 
(fMOTHER-OF X SAM), "Sam has a friend." 


semantic types of 
be represented 
Is (fFRIEND X SAM), "Sam 
support." Is (fSUPPORT X 


definition of "have" (o 
Include within Itself a 
Interpretations (like h 
physical possession) ca 
meanings of "have", and 

the subject and object. 

c analysis ( 


:he possessive, or "of") does not 
of these different relations. A few 
i-as-pert, owning, or having In 
ie reasonably considered distinct 
■e Included In Its definition. The 
nd "support" really are determined b 




lawyer" without doing 




'"“"■'Sb I 
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Add HI one 1 Semantic Information 
A. Using Clauses as Objects 

In order to interpret a sentence III 


use a clause (“you to pick up") as the object of a verb 
("tell"). It generates a pseudo-object of the type fEVENT, 
creates an OSS for that object. In the example mentioned, t 
clause "you to pick up" would have produced the RSS: 


(0) 






NG1 Is an OSS describing the object "the on 
system has set up as the object of the clause, a 
Interpreted as “block". The program SMCU takes 
and produces a corresponding OSS: 

(EVX1) 0 (THGOAL ( 

( 

0 fEVENT fTHING) 




S for "yoi 


and a new PLANNER expression for the event was generated. 
Including the event name as the second element. The reason for 
putting It second Is technical, and should be changed someday 
r convenience and consistency with the scheme 






described In Section 2.1. In the expression, 
OSS Is replaced with Its associated variable ' 
since the new structure will be used as part i 


s case $?X1> 
art of the description 
includes the theorem 


which Is designed to deal with expressions Involving t 

rest of the sentence, this resultant OSS can be used j 
anv other OSS, as an object of a verb, preposition, el 
When PLANNER evaluates the expression. It may ha- 

happened by looking at other events, 
theorem TCTE-PICKUP, and the name o* 
value which Is assigned tc 
B. types of Modification 


ime of the resultant even 
variable EVX1. 



others may make changes directly to the relation being 
constructed. The semantic structures previously built 
analyzed and modified by an arbitrary function which si 
meaning of the modifier. One special facility exists 1 
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substitutions within an expression. It the PLANNER expression 
of a CMEANS or NMEAN5 definition Is of the form (fSUBST al a2 bl 
b2...), the effect will be to modify the existing semantic 
structure by substituting the atom a2 for al, b2 for bl, etc. 


No new expression Is added to the PLANNER description. The word 
"move" might be defined using: 

(CMEANS((((PAN IMATE))((fMAN IP))) (»PUT »2 IOC .TIME) (*MOVE)>) 
This Indicates that moving Is done by on animate object to a 
man I pul able object, and involves putting It at the place "LOC". 
The atom LOC would be given a OSS Indicating an unknown place. 
The resulting RSS has the semantic marker fMOVE. The sentence 


e. If the sentence Is "Move a b 
suit should be (#PUTIM NG1 :BOX) 
a major change In the Internal 


y defining "Into" 


modifying phrase m. 
representation of 

(CMEANS!<((fMOVE))(C#BOX))) (SSUBST <PUTIN (MOVE #2 LOC) 
If a PREPO with the preposition "Into" modifies a clause w 
the semantic marker SMOVE, and the object o 
the marker »B0X, then the definition applies. The 
clause Is changed by substituting fPUTIH for SHOVE 
object of the preposition for HOC. The special s 








CMEANS or NMEANS definition, bell 

C. Using Evaluation In CMEANS ai 

Although every definition has the power to use programs, 
definitions using the standard forms CMEANS and NMEANS are 
forced Into a rather rigid synta* which does not have a 
procedural character. To avoid this, there Is an extra level 
evaluation. If the PLANNER portion of a definition Is of the 
form (»EVAL s) where s Is any LISP atom or s-expresslon, the 
form will be EVALled before the description I 
definition, end Its value used Instead. This 
the usual substitutions for *1, P2, »TIME, et 
of particular use In capturing the semantic regularities 
language by using auxllllary functions li 
example, color adjectives I 
their characteristics. They epply ti 
a relation with fCOLOR, 
separately, we would II 


n defining w 


single function ‘COLOR w 


t color specified. 


(NMEANSC(fPHVSOB) («EVAL CLISTCLIST (I 
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When (•COLOR •BLUE) Is evaluated, t 
i form ((•COLOR ••• *BLUE)), which wll 


As another example, the w 
GRASPING (an object being hel 


whether the VG Is progressive or 
(PROGRESSIVE) finds out whether 
looking at the verb and the tens 


e difference depends on 
t. The function 
clause Is progressive, by 
The definition of "grasp" 


(CMEANS((((*ANIMATE)H(»MANIP)>) 

(•EVAL (COND ((PROGRESSIVE) (QUOTE(fGRASPING *2 •TIME))) 

(T (QUOTE (fGRASP *2 .TIKE))))) NIL)) 

D. Some Interesting Problems 

There are many areas In which the semantic analysis needs 
to be refined and expanded. The system does not pretend to 
contain a complete analysis of English, but Is rather an 
Illustration of how many aspects of semantics could be handled. 
This section describes a few places where modification might 

1. Definite Determiners 

In our system, a definite noun phrase Is Interpreted as 
referring to a unique object or set of objects known to the 
hearer. In more general language use, definiteness Is often 
used to convey new Information. The phrase "my brother who 


lives In Chicago" 










possibilities for tine reference, 
subjunctives, etc. need to be bond! 
version of PLANNER which can tempor 
hypothetical world, or which has mo 


3. Conjunction 

Only the most elementary problems In conjunction have bee. 
dealt with In the current system. Many conjoined structures d. 

lyter programs, and no subtlety Is usi 


not yet hove semantic 
In deciding on tl 
used to Indicate 

of conditional ( 
specification of 
me."), etc. Understa 
discourse problem of 

In addition, no 
nested structures III 
women." Syntactic cr 
distinctions, and a t 


sequonce ("We went to the circus and 
lo saw him and understood."}, as a type 
gain and I'll clobber youl"). In 
• something (“Be a friend and help 

ordering of sentences. For example. 
Indicates a chain of reasoning, 
has been made to disambiguate 


station 







-syntactic Relations 

me placas In English where the rela' 
i not Indicated by syntactic clues, I 
semantics. One example Is chain of classifiers 
In "strict gun law", the law Is 
the gun Is stolen. It Is possible to combine 
> "a helical aluminum soup pot cower adjustment 
sale" In which a large amount of semantic 
■nation must be combined with the ordering to find the 

current system handles classifiers 


Interpretation. 


x deductions t* 


1 separately modify the head, 
use both the semantic markers, 
nd the real relationships. 
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recently mentioned". 
In addition to 



, as In "Ekpleli 
referring back 
description In 


srder to avoid repeating It. 
elephant from Zanzibar neat 


to a big flUfi?". Sometimes 
repetition, we simply omit 


part of a phrase or sentence. We can 
corned-beef sandwich?" with "Bring me 
almost anything with "Why?" In these 


e Includes by Implication a 


sentences which would 


impossible 







without us I ns one of these mechanisms, such ssi “Find e bio 
which Is bliser then anythin* which tuoports is." These 
mechanism, can be used to refer beck to anythin, mentioned 
previously, whether In an earlier sentence of the speeker, o 
of the replies to him, or somethin* occurrln, earlier In th« 










In the ease of sentence 3, It 


1 - THE BLOCK WHICH IS TALLER THAN THE 

ONE I AM HOLOIIIG 

2 - THE ONE I AM HOLDING ? 

A simple transformation Is used to switch 
and moke the corresponding verb changes, and t 
borrowed directly from the Input sentences. 

In our discussion of pronouns, 


checking for agreement w 
pronouns "he" and "she 


ise "It" as typical. 
Identically encept 

heir referent Is In 


fact animate and of the right gender. 

The first thing cheeked by SHIT Is whether "It" has already 
appeared In the same sentence. We very rarely use the same 
pronoun to refer to two different objects In the same sentence, 
so It Is generally safe to adopt the same Interpretation we did 
the first time. If there were several possible Interpretations, 
the system Is careful not to match up one Interpretation from 
•It" with a different one from another 
n building an overall interpretation of the 
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Similarly. If "It" .at used In the orevlous sentence. 


either of these eases, SHIT simply adopts the previous 
Interpretation. 



a situation exists, i 
Ordinarily, when we i 
finding the referent 


s program must work differently. 

Far to “It" we have already finished 
F the IIG being referred back to, and "It" 
'I* 'his case, we have a circle, where 

of the definition of the object It Is referring to. 
the program which does variable binding li 


s able to recognize tl 




y using the s 


clause appearing earlier I 
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nee for objects In such accepteble pieces to which "It 
e previous sentence. The pronoun may refer to any object 


determine which It 

possibilities on 


m different ratines o 


the meaning w 

therefore cannot eliminate any of tl 
ntactlc grounds, but can only give tl 
lauslbl11ty". For example, In Section *.1.5 we discussed the 
"focus" element In a clause. "It" Is more likely 
r to the previous focus than to other elements of the 

Similarly, the subject is a more likely candidate than 
et, and both are more likely than a MG appearing embedded 
:EPG or a secondary clause. 

system keeps a list of all of the objects referred to 
previous sentence, as well as the entire parsing tree, 
lg PROGRAMMAR'S functions for exploring a parsing tree, 
i able to find the syntactic poslton of all the possible 
af.rences and to assign each a plausibility, using a fairly 
rbltrary but hopefully useful set of values (for example we add 
for the focus element beyond what It would normally have for 
position as subject or object). In order to keep the list 
:he objects In the last sentence, our semantic system has to 
i certain amount of extra work. If we ask the question! "Is 
block supported by three pyramids?", the PLANNER expression 







(THFINO ALL $7(1 (XI) 

(THGOAL(»IS $7X1 fBLOCK)) 

(THFINO 5 f?X2 (X2) 

(THGOAL(fIS $7X2 #PYRAMID)) 
(THGOALt fSUPPORT $7X2 $7X1)))) 


Once this Is evaluated. It returns a list of all the blocks 


the description. 


pyramids 


descriptions which 


(THPOTPROP (QUOTE XI) 


(THPUTPROP (QUOTE X 


(TMG0AL(fSUPPORT $ 


(QUOTE 8IN0)> 


(QUOTE BIND))) 


This only occurs when the system Is handling discourse. 

Finally, "It" can be used In a phrase like "Do ItI" to 


LASTEVENT I. saved, and SMIT can us. It to replace the entire 
meaning of "do It" with the description generated earlier for 


handled In a similar way, but with an Interesting difference. 
If we have the sequence "Why did you pick up the ball?" "To 













k , 3 « 2 Substl tutes and Incomplete* 

The next (roup of things the sy 
Involves the use of substitute nouns 
noun groups like "Buv me ins." Here i 
particular object, but must look for 
through a list of particular objects 

Instead, to recover the English descrlptl 
to stand for part or all of that descript 




previous sentence, the t 

In the parsing tree the 
on surface characteristics than on sti 

a TPRON like "anything". Our program 
complex as the one for "It". It Is prlmar 
heuristic of "contrast". People often use 
characteristics of basically similar objec 

o Interpret the descrlptl 


f contrasting adjectives. 


meaning. SMOHE 


"One" depends 

a pronoun or 


it understand 

block", not 







decide how much of the description Is to be borrowed by "one", 
but el so to decide which description In a sentence "one" Is 


referring to. If we say "The green block supports the big 
pyramid but not the little one." It Is fairly clear that "one" 
refers to "pyramid". But If we say "The big block supports the 
green pyramid but not the little one.", then "one" might refer 
to "block". The only difference Is the change of adjectives — 
"big" and "little" contrast, but "green" and "little" do not. 


assumes the most recent contrasting description Is the referent. 
If there Is no contrast between the phrase being analyzed and 
any NG In the same sentence, previous answer, or previous 



noun, adjective, and classifier) and which It does not (such as 
number and determiner). For the noun groups In previous Inputs, 
the parsing Is available, but for the reply, only the actual 
words are available and It Is necessary to construct a simple 
parsing before understanding the meaning of "one". It does not 
call the entire system recursively to do this, but uses a 
simplified version. 

An Incomplete NG, containing only a number or Quantifier Is 




series "Buy me thre 
they are nearly Identlca 
Incomplete NO actually 

Currently the set 
special properties In I 
Involved. It would be 


contrasts Is stc 
dictionary entrl 


djectlves 
he semantic 


I system of PLANNER programs and 









h.s.3 nueral1 Discourse Contest 

Me Neva discussed several ways of using overall discourse 
contest In understanding. We have so far experimented with only 
one of these — keeping track of what has been mentioned earlier 


In the discourse. This Is 
previous sentence for pron 


sentences. If there are 
have a conversation: "What 
pyramid." "What Is behind 




looking back In the 


references, as 
t or occurring 






The phrase "the two blocks" Is to be interpreted as a 
particular pair of blocks, but there may be others In the seer 
and nowhere In the dialog were two blocks mentioned together. 

mentioned. In order to Interpret "the" as "the most recently 
mentioned" In cases like this. 


To do so, we use PLANNER'S facility for giving properties 
to assertions. When w. mention a "green block", the semantic 
system builds a PLANNER description which Includes the 


expressions: 

(THGOAKfIS $?X1 fBLOCK)) (THOOAL(fCOLOR STX1 fGREEN)) 

After the sentence containing this phrase has been Interpreted, 
the system goes back to the PLANNER descriptions and marks all 







e descriptions of objects I 


When the semantic programs find a definite NG like "the two 
red blocks", the second NG specialist (SMNG2) uses PLANNER to 
make a list of all of the objects which fit the description. If 

"reference" of the NG. and the Interpretation of that NG Is 
finished. If there are fewer than called for by the determiners 
and numbers, SHNG2 makes a note of the English phrase which was 
used to build the description, and returns a message to the 
parser that something has gone wrong. 

If the parser manages to parse the sentence differently, 
all Is well. If not, the system assumes that the NG 
Interpretation was the reason for the failure, and the system 
uses the stored phrase to print out a message "I don't 
understand what you mean by..." 

description, SMNG2 

description for the Items It found, but this time using only 
those assertions mentioned In this or the previous sentence. 

This Is easily done by using PLANNER'S ability to put a “filter" 
on the assertions to be retrieved from the data base, allowing 
only those which are accepted by a LISP predicate (which In this 
case looks for a sentence number In the appropriate range on the 




using PLANNER to recheck t 





I DON'T UNDERSTAND WHICH PYRAMID YOU MEAN. 

Of course, a more sophisticated program is needed for 
determining the referents of definite NGs. If the conversation 


previously mentioned, 
biggest cat In the wor 
program must deduce fr 


that book, even though no title w 
here Is a complicated NG like "th 
r "the thing I want to do most". 


one such object, even though It has not been previously 
mentioned, and that It Is being defined by this description. 


It seems likely that these and other similar aspects of 
language can be handled systematically, using the formalism c 
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Iln a system like the one described In this paper 
The semantic and deductive systems provide a framework within 
which we can formalize and combine a variety of aspects of 
meaning and knowl.dg. to deal with the real problems of 


semantics. 




4.4 Generation of Responses 
In this section we will describe how our language- 
understending system generate. It. llngul.tlc responses. This 
aspect was not amphaslted as much In the research as the problem 
of understanding language, and we have not developed a general 
theory of discourse generation. The program, produce behavior 
which seems reasonable for carrying on a dialog about the robot 
world. In particular we dealt with four different aspects of 
discourse production — patterned responses, appropriate answers 
to questions, generating descriptions of objects and events, and 
the production of fluent discourse. 

4.4.1 Patterned Responses 


program Is to incluoe a set ui 
appropriate for the situations It 
responses can be made as complex a 


responses which are 

and the program only repeats 


them. Many language systems make heavy use or t e 
responses to achieve "good sounding” output. 

In general, th... response, are not flexible enough for 
true language system, but there are placas where they are 
appropriate — for example, when the program wants to 
acknowledge that something has happened, or tl 
a certain point In Its analysis. Our system u: 
of patterned response. First there Is a set 


. several types 
simple responses 
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for specific situations. 

sentence Is analyzed, "I 
cannot oe analyzed, and ” 


The system responds "OK." when a 
UNDERSTAND." when a declarative 
ON'T UNDERSTAND." when a sentence 


A slightly 
In the blank" wl 
simplest example 


simply replaced "the" wit 
The "I assume" mechanism 


complex type of response Involves "filling 
Ith e phrase borrowed from the Input. The 
! In our system Is "SORRY, I DON'T KNOW THE WORD 
IPE TWO SPACES." The offending word Is teken as 
I Inserted In the blank. The "two spaces" are to 
buffer of characters typed after the message was 
ihtly more c'omplex types of response Involve 
' determiners of the phrase which was Input. If 
omethlng like "the three green pyramids", and 
t figure out what he Is referring to. It types 
ICH THREE GREEN PYRAMIDS YOU MEAN." It has 
I "which" before filling the blank, 
loes the opposite, replacing an 


miner with "the". If we talk about "some green 
pyramid", then later refer to that pyramid 
ran notify us of Its Interpretation of "It" 
ASSUME YOU MEAN THE GREEN PYRAMID." Here 
rd the Indefinite determiner or quantifier 
ep aced It with "the". It uses knowledge 
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l U l t.2 Answering Questions 

In order to carry on a discourse, we nee 
of responses people eapect to different type 
Section 2.5.5 we classified various types of questions 
syntactically, and we can use this elesslfIcetlon to select 
appropriate answers. The system answers whenever possible with 
a complete phrose, providing as much Information as possible. 

people rarely answer questions with sentences. The natural 

"the red one", certainly not "The red block Is In the boa." We 
have tried to analyze what sort of phrases provide the most 
Informative and natural responses. 

The first case Is the WH- question, and within that class, 
the NGQIsee section 2.5.2), Involving a question NOUN GROUP, 
such as “which block", "who", "how many pyramids", or "what". 

We can divide these Into three classes - "how many", "vague", 
and "specific". If asked "What Is In the boa?", we can answer 
"a blue block and a pyramid" without being more specific at 
Identifying them. If Instead we are asked "Which block Is In 
the boa?" we must use a more specific description like “the 
large blue cube which supports a pyramid." The program must 
generate English descriptions of particular objects, and It must 
be able to generate both definite and Indefinite descriptions. 
This part of the program will be described In the neat section. 










object or objects, 
description. "Who" 
knows of two people, 
responses, so thet a 


straightforward for NGQ ouestlons. If 
ate Indefinite descriptions of the 
Is "which...", we generate a definite 
ver a problem, since the system only 
' and "I". There are also default 
tlon like “Which block supports the 


HOWMANY questlo 
appropriate objects, 


y blocks are not 


"when", "how", o 
Implemented so f 


achieving Its goals 
decide what event I 
see what goal cal let 
the higher goal In 






hy" "when", and "how", but the others 
fashion. A "why" question Is 
memory of the subgoals It used In 
anlpulatlng toy objects. If we can 
referred to In the question, we can 
a subgoal, and answer by describing 


n English description of 
like (SPUTON :B3 STABLE), 
o the objects Involved, 
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separate calls to PLANNER). In the case of the HOWMANY Question 




question, we answer with all three kinds of Information, savin* 

The first element Is "YES" If the answer Is clearly yes 
(for example If the number Is matched exactly, or the number In 
the original question was Indefinite as In this example), "NO" 
If It Is clearly no (for example If there are fewer than 



found matches the request (For example, "Are there three 
blocksf" Is not answered redundantly, "YES, THREE OF THEM: A 

following the number Is changed to "THINGS" If the focus 
contains a TPRON like “anything", or "something". If the number 


At the end of a response, we put the description of the 
such as "exactly...", "at least..." etc. In which case t 










answered "1 


focus originally appeared as the ob 
* repeat that preposition before the 

Is It supported?" Is Implicitly the 


question contains no possible focus since all of I 
DEFInlte, as In "Does the table support the boat", 
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Naming Objects and Events 

The previous section covers all of the different type 
ons the system can handle, and the types of phrases 
n response. We have not yet explained how It names . 
or describes an event. This Is done with a set of 
R and LISP functions which examine the data base and 
nt Information about objects. These programs take 

general, the way an object Is named Is highly dependent on 


s Interested Ii 


Certain features o 


this, as In (IIS :HAND #HAND), (fIS :B1 SBLOCK), and (* 
•COLOR). The naming program for objects first checks f 


case the English name Is simply the concept name without the 
The question "What shape Is the pyramid?" Is answered 
"POINTED." since It has the shape •POINTED. If the the object 
Is not one of these and Is not a fBlOCK, »BALl, or a fPYRAMID 
the program gives up. If It Is one of those three, the correct 









(Including a special check of dimensions to see If 
i "cube"), and a description Is built of Its color 
site. At each stage of building, the description Is checked 
ee If It refers uniquely to the object being described. If 
the determiner "the" Is put on, and the description used 
without further addition. If there Is only one ball In the 
scene. It will always be referred to as "the ball". 

If the description Includes color and site, but still fits 
more than the desired object, the outcome depends on whether a 
specific description or an nonspecific one Is called for. If It 
Is nonspecific, the program puts the indefinite pronoun "a" or 
"an" on the beginning and produces something like "A LARGE GREEN 
CUBE". If It Is specific, more Information Is needed. If the 
object supports anything, the program adds the phrase "WHICH 
SUPPORTS..." then Includes the English descriptions (Indefinite) 
of all the objects It supports. If the object supports nothing, 
the program adds "WHICH IS TO THE RIGHT OF..." and names all of 
the objects to 
characterize tl 

system assume, that It does. If at any point In the dialog, 
object Is given a 

SUPERBLOCK." 

Naming events Is relatively straightforward. 


e object uniquely In some situations, I 

ne. It Is referred to using o 


fPUTON 


•STACKUP) 













h.lt.h Generating Discourse 

The previous sections described 
which can produce reasonable English 


a generating capability 
answers to different types 



avoid this redundancy, the object-nnmer looks for Identical 
descriptions and combines them with the appropriate number ' 


use of substitute nouns. We would 


"Is there a red cube which supports a 



















A.* 1 * !, ? Future Development 

The generation of language Is a comole, subject, wide open 
to future development. Our current system I. just . b.ilnnlni, 
and has some major deficiencies. First, we would like to 
describe an object by using facts which ere relevant to the 
context. In our simple world, we have declared by flat that 
color, site, and support relationships are the Important facts 
about an object, w. could just have well have used location to 

sophisticated heuristics for deciding what features of an object 
will serve best to Identify It to the hearer. 

way to turn an arbitrary PLANNER 
tan handle only specific objects 
and simple events. There are a number of applications for a 
more powerful English generator. For example. In case of 
ambiguity, we shouldn't have to Include special paraphrases In 
the definition. The system should be able to look at the two 
PLANNER descriptions and describe the difference directly In 

The system should be able to tell us more about Itself and 
how It does things. If we ask a question like "How do you build 
stacks?". It should be able to look at I 
convert them to an English description 1 






n programs and 




then..." PLANNER'S structure of goals end subgoals 
a subject for this kind of description, and a great 
e done along this line. In a more speculative vein, 
f discourse generators which could convert an 
Internal logical format Into natural language might lead to 
computer essay writers, or translators which could understand 
the material they were working with. 


Section 


:h Other Semantic Systems 


k.S Comparison w 
k.5.1 Introduction 

This section compares our semantic system with two other 
models for the semantics of natural language. Each has served 
as the basis for computer programs which "understand" language, 
and we will consider the usefulness of the models for this 
purpose as well as their value as theoretical models of a 

The three models can be labelled "categorization". 


"association", and "procedure", 
section of semantic theories, I 
of theory. They assume that li 


represent 


t represent a 
>ne particular 


s knowledge, related by semantics 
espresslng thoughts. This sets 
which avoided postulating 

:ruth conditions or stlmulus- 


coneeputal organization o 
to the linguistic forms ut 
them off from traditional 
mentalIstlc structures and deal 
representations such as logical 
response relationships. 

These three models are oriented towards viewing language 
a human activity rather than an abstract calculus of symbols. 
They study the process In term, of human models, and take Inti 
account the production and Intepretatlon of language. One 
possible reason why the current syntactic theories have been 
weak In developing semantic theories Is their Insistence on a 
"neutral" characterization of the competence of a language use 







speaker or hearer. 


Intel 1Igence of tl 
without trying to 


the process carried out In an Intel!Iient 
. since semantics Involves the Interaction 
lures of the language and the knowledge and 
>e language user. It cannot be understood 
deal with this Intelligence directly. 
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iui^z CategQri7atInn 

The Categorization m 

many computer systems 

The beslc principle 
"semantic markers", dlvl 
Dewey decimal classifies 

"male", "human", "animat 
final distinguishing 
married") is Its "sen 


colorful ball" has two pt 
further Information 


uncle" Is redundant, whl 

producing and understand 

underlying the speak 
systematic way with 


derstandlng natural language, 
a structure of categories, called 
the conceputal world much as the 
subdivides the books In a library, 
'bachelor" has the semantic markers 
'physical object", etc. and the 

stlngulsher". 

arkers are combined according to 
mple, the word "colorful" would be 
orful cube", another In 
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dealt with through this type of categorization. 

Nevertheless, categorization has been used In many computer 
programs for understanding natural language, to help choose the 
right meaning for potentially ambiguous words. Sehank <Schank 
1969, 1970> has extended the application of this theory, using 
semantic relationships to parse sentences conceputally. 
Associated with each sense of . word Is a conceptual 1 tat I on, 
specifying the semantic relationships of that word with other 
words In the same structure. For example, one meaning of the 
word "hit" would be an action of physical striking, whose 
subject Is a "person", whose object Is a "physical object", and 
which has a possible Instrument of the category "weapon". The 

noticing words In categories which could fill the roles, and by 
setting up an appropriate structure. It could also account for 
the Interpretation In which “hit" Involves striking with a fist, 
and "with" represents possession of a "physical object" by a 
"person", but this would be found only on “prompting" (see 
CSchank 1970>, p. 76). 

The underlying belief Is that humans make much use of this 
sort of categorization In understanding sentences, 
doing a complete syntactic parsing. 
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Fodor and Garrett <Fodor 1967> studied sentences like these, and 
found that they are more easily understood when the categories 
associated with the verbs can Indicate the conceptual structure. 
For sentence fragments and ungrammatical utterances, this 
abl 11 ty seems vital. 


















networks carry out computations at e< 
from the association model, towards i 
program. 

Some types of natural I 
Involve simple associations 
"almond", a person will (If 
think of the word "cookie". 

appealing to picture a shor 
and each of the original word 

ambiguous word In a sentence, 
to each of the concepts It m 
the other words In the sentence should b. 


model of semantics as a 

understanding do appear to 
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s eaten In Chinese restaurants) 
s hard to describe logical 
quick reaction, and much more 
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b.5-k Procedure 

We can call the model of semantics used In our system t 
The primary organization of knowledge Is 
ram with the power to combine Information ab 
the parsing of the sentence, the dictionary meanings of Its 
words, and non- 1 Ingulstlc facts about the subject being 
discussed. Any relevant bit of knowledge can Itself be In 




time In the process of understanding. The program operates on a 
sentence to produce a representation of Its meaning In some 
Internal language. In our case PLANNER. This language allows the 
expression of a wide variety of the aspects of language — 
'oglcal connectives and quantifiers, time references (provided 
by verb tenses and modifiers), different sorts of object- 
modifier relatonshlp,, types of object reference (e.g. the 
difference between "the dog" and "a dog"), etc. 

In analyzing a sentence, the program can use Information 
about previous sentences In the discourse and about the subject 
being discussed. This allows It to deal with features of 
language such as pronoun reference, substitute noun^ the effect 
of discourse on specific referents, and the disambiguation of 
meaning through knowledge of non-1Ingulstlc facts (like Bar- 
Hlllel's classic example of the "box In the pen" <Bar-HI1lel>). 

Other programs, such as (Woods 1969) also use the procedure 
model. These programs use a complete syntactic parsing of the 







Input to provide a framework from w 
what aspects of meaning to deduce, 
language-comprehending programs hav 
a simplified form, performing only 
deduction In analysis, and having a 
to a specific application. 


the program can di 
majority of the 
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ternal language tailored 








Jui.5 Evaluatln. the Models 

There Is no single set of criteria to judge the success of 
a model of semantics or . computer program for "comprehending 
language". Success Is relative to the goals of the model, and 
the aspects It wishes to describe. Four criteria seem to be of 
Importance both In computer language comprehension and In 
developing a theory of semantics. These are: ability to 
combine syntax and meaning ; efficiency; ability to explain 
human performance; and the ability to understand language In 
context. These will be discussed separately. 

A. Integrating Syntax 


natural language, and no model sheds eoual light nn all of them. 
In fact, two of the three models are limited to one part of tha 
meaning — the basic semantic relationships between the words 
used In the sentence. 

The Fodor-Katz version of the categorization model does not 
attempt to deal with the part of meaning expressed by the 


semantic distinguishes, analyzing only those aspects which can 
be modelled by the markers. It does not work with other aspects 
of meaning such as tense, mood, and reference to objects. 
Schenk's version attempts to model the way people understand a 
sentence, describing an actual parsing process. However the 
conceptual parsing does not actually find the "meaning”. One 
argument for the model Is human ability to understand utterances 
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f semantics In which syntax plays a large role, 
odel pays more attention to a complete 
understanding of a sentence, trying to interweave syntax, 
semantics, and deduction In order to actually answer a Question 
use a piece of new Information, or follow a comnand. 

B. Efficiency 

It would seem reasonable to look for capabilities of the 
other two models not possible for the procedure model. In one 
sense, this quest Is a joke. Since a procedure system has 
Information In the form of programs, those programs can Include 
simulations of any other model. The significant question I. not 
what Is possible theoretically, but what Is reasonable to do. 

A program could play a simple game Ilka HIM by using 
standard strategies of mlnlmax and look-ahead. If It could win 
It would provide a successful model of NIM playing. However It 
makes no use of the simple winning strategy, and therefore Is a 
bad model for the specific game. Similarly, the procedure model 
:s In a general way, saying that every part of 
s Involves powers of deduction and the ability to 
combine Information of a variety of types. If In fact, major 
parts of language comprehension can be explained by more 
elementary approaches, the general procedure model Is not a good 
description for those areas. 


e modelling a natural p 
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of computational complexity Is barely charted, an 
mposslble to determine that some computation Is 
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dangerous to characterize high-level processes 
, since a computation which takes Impossibly loni 
e may be trivial for another. However, there It 
nse In which efficiency can be judged. A 
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looking through the things It knows about 
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lonshlps. This seems clearly more complex than 
of a simple association link. Those who advocate 

deductive process needed to find the path would b 
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ch would change the parsing task Into simply 
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Is Is the approach taken by both Schank and 
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ot the parsers which have been written for 
a simple set of semantic criteria seem to analyze 
y without any complex syntax rules. 

(tailing Human Behavior 
difficult t 

structure i 


various models. 


o find psychological experiments which 
ne model and another, since the underlying 
s too complex to Isolate a "single 


h communication, people 


tence fragments, scattered words, and blurred 
require filling In much of the meaning. In a 
Irlng a complete parsing, this would add a great deal 
Ity, since the parser would have to know about the 
types of fragments as well as the grammatical 
A semantic relation model suggests that the syntax 
id at the end of the process, to check on the 
message. If the syntax Is lacking, the final check 
it the basic meaning Is still discoverable. 

volve simple assoclatlonal links. Often the punch 

* comes from recognizing the Inappropriateness o 

Ink is not as Irrelevant as It outwardly seems, 
•per connections. 







s about language 
comprehension Is that .enteneee do not appear In logical 
Isolation, but are always part of a context, both of other 
utterance, and of the situation In which the, are uttered. Some 
semantlclsts try to avoid this problem, saying It «o.s beyond 
the proper realm of semantics. Keti and fodor believe that 
"...a semantic theory cannot be expected to account for the way 
setting determines how an utterance Is understood." C<Katx> P. 
086) However, If semantics Is to be a study of the way language 
and meaning are actually related, we cannot Ignore the facts. 

One of the main strengths o 
ability to Include all sorts of knowledge li 
at any stage of semantic analysis. Tl 
contextual knowledge just as easily ai 
definitions or syntax. Within tl 
procedure model, the 


n making deductions 

the dictionary 

re can be a detailed model of those parts of 
the context which are needed for understanding (for example a 
memory of the objects which have been mentioned, so pronouns car 
refer back to them). The examples below show some of the 
problems Involved In other models when context enters Into 


conceptual 
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The earlier example of "goose" "quill" "oen 1 Ink could be 
extended one place further from "Ink" to "spot". It s 
extremely unlikely that a sentence containing "spot" and "goose" 
would actually In.olve this connection. Yet It might be a much 
shorter path than the one actually representing the connection 
In "I spotted a goose." As the amount of knowledge grows, there 
will be a rapidly expanding number of false paths, made up of 
links which are Individually very close, but which bear no 
logical relation to each other. Since the association network 
does not check the logical relations of the links until after 

By Including specific knowledge, this problem Is 
exacerbated, since each node will have a large number 
of widely differing logical types. 

There are various ways to sneak deduction Into the 
association model, and for each simple example. It Is possible 
to design a trick which cuts out the Irrelevant links 
(Quintan's distinction between property and superset links 
<Qul....n I. .««*!.>. *»• «—"* of 1 

the net Increases, It needs more ad-hoc deductive schemes, and 
In order to handle language generally, the association net will 
become a full-fledged parallel processor using procedures to 
find semantic relations. 

In addition to swamping the system with Implausible links, 
the association model can produce very plausible I 
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tl.5.6 Conclusions 

Although the procedure model see 
of language behavior than either of t 
parts of language understanding where 
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Types £f Knowledge 

In evaluating the flexibility of a system, we must consider 
the four different levels of knowledge It contains. 


changed without remaking the entire system. This Is Its "Innate 
capacity" — the embodiment of Its theory of language. At this 
level we must deal with such questions as whether we should use 
a top-down transformational parser, a semantic net, or some 
other approach to the basic analysis of a sentence, or whether 
we should have special tables of Information or a general 
notation (such as the predicate calculus) for representing 


The second level of knowledge Is the complex knowledge 
about the language and the subject being discussed. This would 
Include such things as the grammar of a language, or the 
conceptual categories Into which the speaker divides his model 


type of knowledge which Is obviously not Innate (since the 
grammar would be different for English and Chinese and the set 
of concepts used would differ for talking about toy blocks and 
talking about love stories). However It 1s not something which 
he learns by being told, or which he changes very easily. Over 
a period of years, he builds up a store of very complex. 
Interrelated knowledge, which serves as a framework for more 
specific Information. 




r storehouse o 


f knowledge about the 
id our world. It Includes the meanings 
c we called "complex knowledge" In 
i Include such things as "A house built 


e continually learning 


Finally, the fourth level Is the set 
which are relevant to a discussion. This 
"Flight 3h2 leaves Boston at noon.", "The 
tall.", or "A banana Is hanging above the 


of specific facts 
Includes facts such as 


easiest type to learn, since It dot 
Interrelationships. It Is more 11 
table or a new simple assertion Inl 
sharp distinction between levels tl 
given system there will usually be 
handling Information corresponding 


two different ways of 
to this distinction. Let us 
Inference, and semantics, and 
knowledge relate to language 


understanding programs 










the rules, end the grammar becomes a tangteo wen 
new addition must be carefully fitted. For enemp 
complexity of current transformational grammars fi 




graimars < 
recognIze 


e transformational 




e recent programs w 
ds 1970>. tBobrow 1970> CThorne 1! 

adopt a more Interrelated representation such as networks. 

In our system we have used programs to express the grammar, 
as explained In chapter 2. This Is not a return to the original 
first-level representation, since the grammar programs are 
completely separate from the system Itself. One of the 
arguments for using syntax-directed p 

rules could be expressed In a uniform way which did not dep 
on the details of the parsing program. Therefore changes e 
be made more easily and the grammar was expandable. By 
designing a special language for writing grammars, we con u 
representation which Is just as general a 
but which allows greater flexibility In designing a 
relating It to semantics. 

How difficult Is It to change our 
changes (like allowing noun groups to 
In "Are there any books? I want three 
additional lines of program would be n 
substantial change (like adding a new 


e grammar 


x-rule tables. 


if modifying clause) 


grammar 




In different pieces which would be effected. The first change 
could be done with little difficulty by enyone with en 
understanding of PROGRAMMAR end section 2.J. The second would 
teke e deeper understendlng of how the grammar Is written, but 
would still Involve only e smell emount of erogremmlng, end of 
course would not Involve chenglng the beslc system et ell. The 
gremmer wes written to be felrly complete end with expansion In 
mind. It seems flexible enough thet we will be able to Include 
as much of the the complexity of English as we want. 

What is important In terms of learning Is that this Is 
level-two knowledge — It Is the type of knowledge which Is 
learned once in a lifetime by a person (or computer program), 
and should not need any major changes after childhood. 

Therefore although It must be changeable, we do not need to 
worry about “oulek" learning techniques. If any learning Is 
studied at this level, we must deal In a sophisticated way with 
the methods used to learn large amounts of complex Interrelated 
material. Those computer programs which have "learned" syntax 
<<McConlogue> <Slklossy>) have done so by taking such an 
oversimplified view of syntax that the results hardly have 
significance for natural language. 

At level three of our knowledge of syntax, we have our 
knowledge of particular words, their grammatical categories and 
peculiarities. We need to ask. How easy Is It to add new words? 
How much do we have to know about the grammar to Increase the 




vocabulary? In most systems there are a re 
"be", "there", or "than") which have complex and unique 
grammatical behavior. These are built Into the grammar 
Initially at level two. The rest of the vocabulary, like nouns 
and verbs, can be specified In a simple format. Our system Is 
no exception. To add the words "eat", "purple", and "walk" to 
the system, w. would only need to know the right abbreviations 
(from section 2.3) to enter In I-ISPs 
(DEFLIST WORD (CAT (NOUN NSIUPURPLEIAOJIMWAUCIVB INF ITRNS))) 
This says that "cat" Is a singular (NS) NOUN, "purple" Is 
an ADJectlve, and "walk" Is the INFInltlve form of an 
InTRaNSItlve VerB. 

Can we give this Information In English? It would be 
straightforward to add the right terms ti 
up simple PLANNER theorems which would a 
a noun." or ‘"Walk 1 Is an Intransitive vi 


e vocabulary ai 


Interesting project t 


r this 


e extended. 


programs have avoided giving dictionary entries to these "open 
class" words (like verbs, nouns, and adjectives) and let the 
parser determine their part of speech from context. (Thorne 
1969) This approach Is not generally meaningful for a complete 
language understanding s 
meanings. It could be 




em, since we need a dictionary o 
d when adding new words to the 
o trivially In our Input program 
to have all possible "open clas 




grammatical features, then letting the parser choose the correct 
ones for the contest. 






5-1-3 Inference 

In the domain of Inference, there has been tremendous 
variation In how different systems treat knowledge. In the 
early programs, all of the complex Information was at level one 
(built Into the system), while the specific facts were at level 
four. As we have discussed, this made it very hard to modify or 
expand the complex Information held by the system. In the 
theorem provers, all of the complex Information was treated at 
the fourth level — as a set of Individual formulas which were 
treated as Isolated facts. At level one, they have a uniform 
proof procedure as the heart of the system. He have discussed 
how this lock of Information at other levels (Information about 
the Interrelationships between different theorems) severely 
limits this approach. In our system, only simple assertions 
(such at "Noah Is the father of Jefeth.", or "Parent-of Is the 
converse of Chlld-of.") are dealt with at the lowest level. The 
rest of the knowledge Is In the form of PLANNER theorems which 
have the ability to Include Information about their connections 


3 about canaries and tl 


relationships with other parts of the knowledge. Other 
theorems, such as the BLOCKS programs (section 3.4) for keeping 






r PLANNER), a 




Information at each of the levels. At the two ends the 
Is clear. At the too we have PLANNER and our committment to Its 
kind of theorem-proving procedures. Any change In this Is a 
major overhaul. At the bottom level, we have simple facts like 

facts which the system plays with whenever It Is conversing. 

They can be changed by simply telling Information (either In 
d are changed automatically when things 
r example If we move the red pyramid) 
the much more Interesting problem, 
t the second level we have our basic conceptual model of 
rid. This Includes our choice of categories for objects, 
f representing actions, time, place, etc. One of the 
f PLANNER (and of lisp. In which It Is embedded) Is 
that we have a variety of useful facilities to represent our 
world efficiently. Section J.k described the BLOCKS world, and 
It should be similarly easy to define new worlds of discourse 
for the system (see below for examples). 

The third level presents the most Interesting problems for 
adding new Information to the system. It Is simple to do so In 
PLANNER by adding new theorems, but we would like to do It In 
English as wall. Of the previous systems, the only one. which 
could accept complex Information In English were the theorem 
provers which dealt with It at the fourth level (as a set of 
r sample dialog, we have some 


benefIts o 






examples of telling the system simple end slightly complex 
Information In English. Saying "I like blocks which ere not 
red but I don't like anything which supports a pyramid." 

like something, prove that It Is a block and that It 
red." This Is no different from a formula for any theorem 
prover, .Inc. It Is not related to the system In any complex 
way. The second theorem says, "If you are trying to prove that 
I .Ik. something, and you can prove that It supports a pyramid, 
h I " This Interacts with the other goals and theorems, 
but In a very specialized way. 

M h smarter programs could be built to accept complex 
Information and us. It to actually modify the PLANNER theorems 
rh, data base, for example, we might have a theorem 




on top of It. We would like to say In English, "H 
to pick UP a block, first take everything off of li 
the system add this Information to the theorem In 1 
n additional goal statement at the beginning. In i 
S, the system must have not only a model of the wo 
.bout, but also a model of It. own behavior, so th. 
: It. own program, as data to be manipulated and 
This Is one of the most fascinating directions I 

Is the possibility of letting the system learn 
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have a theorem which proves 
y proving It supports nothin*), 
the PLANNER 


e should ai 


(THASSERT (fCLEARTOP $?X> 

data base the assertion that this block Is clear. If we then 
need the fact a*aln, we don't need to repeat the deduction. I 
a sense the system has "learned" this fact, since It has been 
added to the data base without being mentioned In the dialog. 
But In another sense. It hasn’t learned any new Information, 
since nothing can be deduced with this fact that couldn't have 
been done before using the theorem that already egisted. A moi 
Interesting type of learning w 
PLANNER theorems for accomplishing a 


n achieved li 


e shown by changing t 


anything you c t 

suggest trying that theorem first. , 
would have a heuristic program which 
particular 


recommendation (THTBF THTRUE) meaning try 
If the goal Is achieved using some particular 
ave the system change the recommendation to 
more advanced stage, we 


worked or didn't work In a 
case. It would then modify the recommendations t 
best theorems In whatever environments came up In 
: might also recognize the need for new theorems I 
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Dt Involve Juggling parameters or 
f Information. Instead It Involves 
deas wrong (or right)?" and "How can 


r generalize them?" It Involves a 


f "debugging" o 
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Since semantics Is the least understood part of language 
understanding. It I. difficult to find a clear body of “l.y.l 
one" knowledge on which to base a system. Our system has . 
basic approach to semantics, explained In chapter *, but most of 
the semantic work I. done at level two - the Interrelated group 
of LISP programs for handling particular semantic Jobs. At this 
level we have two separate areas of knowledge. The first Is 
knowledge about the language, and the way It I, structured to 
convey meaning. This Includes knowledge such as "In a passive 
sentence, the syntactic subject Is the semantic object.", “A 
definite noun group refers to a particular object In the world 
model, or "'It' is more likely to refer to the subject of the 
previous sentence than the object." This Is closely tied to the 
grammar, and Is about as hard to modify as the grammar programs 
themselves. The other type of level two knowledge Is the 
network of "semantic features" described In section k.2. This 
Is peculiar to the domain being discussed, and becomes more 
'f discussion Increases. As we pointed 


out, this Is currently separate f 
used for inference by PLANNER, bu 
As with level two knowledge In otl 
something to be quickly learned ar 
how language conveys meaning grows 
Its syntactic structure, and Is jt 


im the network of "concepts" 
the two could be combined. 

1 changed. Our knowledge of 
along with our knowledge of 
t as seldom modified. 






>f semantic Information 


In most language 

■n be added without 
fi word Is a program I 


At the third level we have the bul 
— the meanings of Individual words. T 
must be easy to change and expand. As 
understanding systems, this knowledge I 
dictionary entries, so that new words c 
changing others. The definition of eac 
the "semantic language" described In section k.2. and we gain 
great flexibility from this program form. The writer of 
semantic definitions does not have to be concerned with the 
exact form of the granmar, and If he wants to enter simple 
words, he can use a standard function to describe them very 
simply. Host words can be added by using the functions CMEANS 
and NMEANS, or by using the particular simple semantic form 

... _ (fnr pxanole. we would define 

appropriate to the type ot wore \ror 

"thirteen" by ((HUH «»>. If « ««>« • of ”' Mn,,e 

problem or relationship we hadn't anticipated, or which Involves 
relating things In an unusual way, we can write a LISP function 
a, the definition of the word to perform the required 
operations. 

flexible and could be easily adopted to handle other fields of 
knowledge and to have a large vocabulary. It would be nice to 
enter new definitions In English Instead of having to use the 
special semantics language. In our sample dialog, the sentence 
“A "steeple" Is a stack which contains two green cubes and a 


Section 




pyramid." produced a new definition f. 


a bit deceptive for 


anted to define the word "face", so that we 
l talk about the faces of blocks, the system would be 
n* the basic concepts and relationships necessary to use 
ew word. This kind of knowledge Is at the second level, 
e cannot expect to add It through a simple definition, 
must be a powerful heuristic program which recognizes the 
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If. This might have varied consequences throughout tl 
', uhBreve, ‘ relations such as "part" are Involved. 
Thus although our system can accept definitions of si 
Is a worthwhile but untried research project to 
ihleh will really be able to learn new words In i 
ig way. We believe that this will be much easlei 
’ environment of a probl 
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I put the butterfly wine on the teble end It bro 
The understanding of the referent of the prono 
depend on the likelihood of the different objects 
causing breakage. This could be handled by having 
declarative sentence "Interpreter" try ou 

Out system can currently do 
the world needed Is a specific s 
In the box.") or a categorical f 
blocks.") A more complex system 
declarative statements and 

seek the interpretation which is neither trivial n 
Incongruous, but which provides new Information as 
must have Intended It to. Contextual factors play 
role. The expectations might be completely r 
sentence were preceded by "The strangest thing just h, 

Finally we have the problem of speech communleat 

hardware, but one of knowledge. Spoken language c, 
listener to fill In a great deal from his own know 
understanding. Words, phrases and whole Ideas are 
fragments and mumbles which often serve as little more than a 
clue as to what they intend. The need for a truly vertical 








system Is much greater for speech 
The analysis at even the lowest Ic 

and deductive programs if 


r wrltten language. 


communicate under conditions 
pick out Individual words or 

to Integrate the syntactic, semantic 
flexible way. We allow meaning to 
guide the direction of the parsing. Our semantic Interpretation 
Is guided by logical deduction and a rudimentary model of what 
the speaker knows. For spoken language this must be expanded. 
Perhaps we might look for fragments o 
meaning to help piece together the re 
create a unified system li 


rest. Or possibly we couli 
e deductive portion could 
t It thought the speaker 


might be saying, on the basis of meaning, and 
In the utterance. It might be possible to hav 
dimensional analysis In which prosodic featun 
Intonation could be used to recognize 
utterance. This Is not at all saying 
syntax overboard In favor of some sort 


features of t 

le relational 


en the most Important clues about what 
said are the syntactic clues. What Is neeeded Is a g 
which can look for and analyze the different types of 
patterns rather than getting tremendously Involved wl 
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COMPAR 121, 151, i: 
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(NG OBJ B DET NS DEF) 

((THE (GET NPl NS DEF)) 
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(DEFTHEOREM 


(THVSETQ S_Z STY)) 


(THASSERT (‘CONTAIN STZ « 


(OEFTHEOREM TC-MAKESPACE 

(THCOIISE (SURF SIZE OBJ »™ CE 

(•FINDSPACE tTSURF STSIZE 
(THNOT (THGOAL (‘IS STSURF 


lTHRU 1 '*'* "BUR' 

(MEMORY) 

(THANO (THGOAL t‘SUPPORT STSURF S_X>> 
(THGOAL (‘GET-RIO-OF STX) 

(THUSE TC-GET-RID-OF))) 
(THOR (THGOAL (‘FINDSPACE SJSURF 


(memorend G (*makespace 




(‘MUHt SIHCAJuri » 
(THVSETQ S_MEASURE 

(GET $?ME-o. 
(GREATERP (SJMEASURE 


'sTMEASURE (QUOTE MEASFN))) 


(SJMEASURE STY)))) 


(DEFTHEOREM 



(OEFTHEOREP 


) CTHUSE TC-GRASP)) 


(THBO»L^(»PICKUPJ?EV J 
(THUSE^TCTE-PICKUP))J; 


(«P 


(THSUCCEEO)) 


V JTTIME))) 

{ISiU 0 !! 0 *»’event‘evemtiist) 

'"ET JTEVENT (QUOTE TYPE!) 

UOTE (JPUTON TGET-RID-OF))} 

JTEVENT JTTIME) 

HGOAL (FPUTOH JTEVENT STX T)> 

HGOAL (FGET-RID-OF JTEVENT JTX))) 

(AND (PUT^ {?fv ESYM (0U0TE E ”> 

(PUTPROP JTEV 

(QUOTE ItART))° U ° TE END,> 
(QUOTE END)) 

!! EV ^QUOTE VPICKUP) (QUOTE TYPE)) 
(PUTPROP JTEV JTEVENT (QUOTE WHY)) 

(DEFTHEOREM TE-CONTAIN (THERASING (X Y) 
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(GO POPRET)) 
(SMPREP (QUOTE ADJ)) 
(GO POPRET))) 




(THICK ((ADd (NMEANS ((APHYSOB) (('MORE ATHICKNESS 


(THING ((NOUN (NMEANS ( 
(WHO ((PRONREL^jSETO SI 
(WHY ((QADJ (FQ WHY))) 


HICKNESS (APHYSOB) Nil 
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